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FOREWORD 



Foreword 

"1 "he OECD Guide to Measuring the Information Society provides a standard reference for 
statisticians, analysts and policy makers in the field of Information and Communication Technologies 
(ICTs). It summarises the statistical standards and de/initions developed by the OECD Working Party 
on Indicators for the Information Society (WPIIS) to inform the activities of the Committee for 
Information, Computer and Communications Policy (ICCP). 

The Guide was first released on line in 2005 and has been updated every second year to reflect 
changes in the information society and its measurement. The 2011 Guide is the first print edition; it 
iuas prepared by the Economic Analysis and Statistics Division (EAS) of the OECD Directorate for 
Science, Technology and Industry. 
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Preface 

For the last decade or so, developments in information and communication technology 
(ICT) have attracted increasing attention. The need for statistics and analysis to support 
and inform policy making in this area has grown in parallel. Since 1999, the OECD Working 
Party on Indicators for the Information Society (WPIIS) has been providing statistical 
standards and comparable data to member countries and to the wider international 
community. Furthermore, WPIIS has analysed these statistics in order to assess the impact 
of ICT on growth, productivity, innovation and education. 

The WPIIS provides a forum for national experts on ICT statistics to come together, 
share national experiences and agree on standards for measuring the information society 
in a comparable way across countries. In particular, the WPIIS has developed definitions of 
ICT sectors and products, electronic commerce and ICT infrastructures. The WPIIS has also 
established two model surveys to collect statistics on ICT access and use by households 
and individuals and another for ICT use by businesses. These statistical standards have 
been adopted not only by OECD members but also by the European Union and the United 
Nation Statistical Commission. 

As a pioneer in the field of ICT indicators and statistics, the WPIIS has contributed to 
establishing a co-ordinated system of international fora in which this work now takes 
place. In this context, the Partnership on Measuring ICT for Development brings together the 
main international organisations in the field of ICT, such as Eurostat, ITU, UNCTAD, the 
World Bank and several UN Regional Economic Commissions. The Partnership helps 
countries beyond the OECD area to adopt the same statistical standards and to build the 
capacity and infrastructures to collect these statistics. As a result, the Partnership's ICT Core 
Indicators allow us to monitor the development of the information society worldwide. 

The OECD Guide to Measuring the Information Society summarises the main outcomes of 
this work and provides a standard reference for statisticians, analysts and policy-makers 
in the field. In particular, the Guide should assist newly participating countries to start or 
develop statistical programmes to measure the information society. 

The Guide was firstly released in 2005 and has been updated every second year to 
reflect changes in the information society. The 2011 Guide is the first print edition. Its main 
additions include: the revised definition of e-commerce (Chapter 5); the revised 
classification for measuring ICT goods (Annex 2.A1); an update of the international scene 
(Chapter 8); an update on measurement in non-member economies (Annex 8.A2); and the 
revision of the Partnership core ICT indicators (Annex 8.A3). 

Previous editions of the Guide are available online at wvjui. oecd.org/sti/measuring- 
infoeconomy/guide. 
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Chapter 1 



Introduction 



The introductory chapter to the Guide provides answers to the /olloiuing key 
questions: What is the information society, in statistical terms? Why has the Guide 
been produced? Who is the intended audience for the Guide? What does the Guide 
contain? 



1 here is little doubt that information and communication technology (ICT) has 
promoted profound economic and social change over the past decade or so. The need for 
statistics and analysis to support and inform policy-making has grown alongside the rapid 
emergence of new ways of communicating, processing and storing information. 

The Guide to Measuring the Information Society documents the work of the OECD and 
others in developing statistical standards for measuring the information society. While the 
main focus of the Guide is on the work of the OECD's Working Party on Indicators for the 
Information Society (WPIIS), relevant statistical work in other areas of the OECD, National 
Statistical Offices (NSOs) and other organisations is also included. 

The introductory chapter to the Guide provides answers to the following key questions: 

• What is the information society, in statistical terms? 

• Why has the Guide been produced? 

• Who is the intended audience for the Guide? 

• What does the Guide contain? 

The information society, in statistical terms 

There is no agreed comprehensive statistical framework of the information society. 
One possible conceptual model is shown in Figure 1.1 and encompasses the widely agreed 
elements of ICT supply, ICT demand, ICT infrastructure, ICT products and "content". 

A complementary framework is the well-known S-curve (Figure 1.2 below), developed 
to describe indicators for electronic commerce but often used to describe ICT 
infrastructure and demand more generally. It considers three stages as follows: 

• E-readiness - preparing the technical, commercial and social infrastructures necessary 
to support e-commerce. E-readiness indicators allow each country to construct 
a statistical picture of the state of readiness of the infrastructure necessary to engage in 
e-commerce. 

• E-intensity - the state of e-commerce use, volume, value and nature of the transactions. 
E-intensity indicators permit countries to profile who is exploiting e-commerce 
possibilities and who is not, and to identify leading sectors and applications. 

• E-impact - the value added potentially created by e-commerce. Statistics are needed to 
evaluate whether and to what extent e-commerce makes a difference in terms of 
efficiency and/or the creation of new sources of wealth. 

The Guide and its rationale 

The Guide is a compilation of concepts, definitions, classifications and methods for 
information society measurement and analysis. 

Much of what is contained in the Guide comes in the form of recommended guidelines 
for statistical measurement that, in this context, refers to the production of statistical 



12 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



1. INTRODUCTION 



Figure 1.1. Information society statistics conceptual model 



ICT supply (producers and production) 

Which industries? Constitute the ICT sector 
Which entities? Produce ICT goods and services 
About them? Industry, size, other characteristics 
About their products? Type of, and revenue from 
ICT goods and services produced 
How much? Expenditure, wages and salaries, 
income, profit, value added, capital expenditure 
How long? Business demographics, established 
vs. new entities 

Employment? How many persons are employed, 
their occupations, qualifications, gender; 
demand for skills 

Where? Location of operations, customers, 
suppliers 

Innovation Innovative activities of producers 
(patenting, R&D) 

What impacts? On the entity, economy, society, 
venvironment 





ICT products 

Definitions and classifications , 
Imports and exports 

Price and quality 
Impacts (e.g. trade) 




ICT demand (users and uses) 

Which entities? Use ICT G&S 

About them? Industry, size, socio-demographic 
and labour force characteristics, etc. 
Which activities? Use of the Internet, 
e-business, e-commerce 
How? Technologies used, means of Internet 
access, changes in technology, 
IT security measures 
How much? E-commerce income and 
expenditure, ICT expenditure and investment 
When? Most recent use, when started using, 
frequency, time use patterns 
Employment? Use of ICT by those employed, 
ICT specialists and generalists, demand for 
skills, nature of work affected by ICT 
Where? Location of users, customers, suppliers 
Why? Why not? Motivations and barriers 
What impacts? On the entity, economy, society 
environment 



ICT in a wider context... for example 

Social and economic factors affecting ICT use and development, 
e.g. education and income levels 

Effect of domestic policy and regulatory environment on ICT infrastructure and use 
Global factors and relationships 

Influence of other factors on ICT impacts e.g. skills and innovation 
Source : OECD. Directorate for Science, Technology and Industry, Economic Analysis and Statistics Division (DSTI/EAS). 



Figure 1.2. Development of e-commerce markets and measurement priorities: 

the S -curve 
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indicators from mainly official sources such as surveys of businesses and households, and 
international trade data. 

The Guide describes areas of work sufficiently advanced in their conceptual and 
definitional underpinnings, and for which sufficient experiences have been accumulated, 
to provide guidelines that will enable the collection of internationally comparable 
statistics. It also includes areas of work that are in early stages of development and 
therefore represent work-in-progress. 

For the benefit of both practitioners and newcomers, the Guide includes background 
information on the policy context and the debates that occurred during the development 
of OECD standards on information society measurement. 

The information society 

That we live in a period of unprecedented technological change, both in terms of the 
extent and speed of change, has been discussed extensively. Many of the underlying 
transformations are undoubtedly associated with the set of interrelated and, more 
recently, converging technologies that have come to be known as ICT. They permeate every 
aspect of life - economic, social, political, cultural and otherwise - and have created great 
interest regarding their actual and potential impact. 

The last two decades, in particular, have witnessed the widespread adoption of a great 
number of such technologies, notably the personal computer, the cell phone and the 
Internet. Together with their multitude of applications, ICT touches on nearly every known 
economic and societal norm. Today, in many OECD and other countries, the majority of 
businesses use computers and the Internet as a matter of routine. Unheard of until fairly 
recently, life without e-mail and the World Wide web seems like an anomaly today. 

The economic dimension 

ICT has had, and will continue to have, significant economic implications. Businesses 
are transforming their supply and demand chains, as well as their internal organisation to 
fully exploit ICT. Governments are restructuring their internal functions and the way they 
deliver services and generally interact with citizens and businesses. People are modifying 
their consumption and spending patterns, as well as their behaviour. In the process, nearly 
every economic variable of interest is affected. 

ICT has greatly contributed to the process of creative destruction, through the birth of 
new firms - and industries - and the death of others, with visible impacts on industrial 
organisational structures and obvious implications for employment. Directly and 
indirectly, ICT can reduce market friction and transaction costs and affect competitive 
positioning, with resulting implications for productivity improvement and economic 
growth. 

The social dimension 

The nature of ICT is such that its use and impacts extend well beyond the economic 
domain. This is so because ICTs are general purpose technologies that can be used for a 
broad range of everyday activities. New modes of individual behaviour have emerged, 
including new or modified means of personal communication and interaction. The rapid 
increase in use of Short Message Service (SMS) in some parts of the world represents but 
one such manifestation of these phenomena. The phenomenon of the so-called digital 
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diuide, which arises from uneven access to new technology, is a very important aspect of 
the social dimension. 

Rationale 

While new research interests emerge periodically as our societies evolve, they are 
often definable within rather specific boundaries - an important activity, an industry or a 
phenomenon. The information society is not so simple. A host of questions, and even 
controversy, have surrounded it ranging from the economic (both macro and micro), to 
the social (exclusion, cohesion), the socio-economic (the digital divide), the political 
(e- democracy), the cultural and beyond. 

If decision making on these issues is to be informed, the production of relevant and 
reliable quantitative information is imperative. For example, without statistics on business 
use of ICT, the productivity paradox could not be understood; e-commerce could not be 
placed in proper perspective without measurement of both consumer participation and 
firm activity; the digital divide cannot be meaningfully addressed without measures of 
what divides whom and where; national e-strategies aimed at growth and economic 
development can neither be designed nor evaluated without appropriate indicators. 

The need for measurement brings with it the need for statistical standards and, 
perhaps as importantly, broad access to - and understanding of - those standards. 
However, the need for statistical standards does not, by itself, provide the impetus for a 
work such as this. A critical mass of knowledge is also required and, as shall become clear 
in the chapters to follow, a considerable amount of new knowledge has been generated in 
a relatively short time. 

Significant progress has also been achieved with respect to use of that knowledge by a 
number of countries. The OECD definition and quantification of e-commerce, for instance, 
has played a key role in policy developments internationally. The original (1998) definition 
of the ICT sector replaced several competing and incompatible ones and its 2009 revision, 
along with revised classifications of its products, are poised to do the same. Finally, the 
model surveys of ICT use have set standards for such surveys in both OECD and non- 
member countries. 

Expected benefits 

It is hoped that the Guide will facilitate improved harmonisation of practices in this 
area of statistics. This, in turn, will enable better international comparability of data, a key 
requirement for benchmarking, identification of relative strengths and weakness, and 
tracking progress. 

The Guide will be useful for countries that already have measurement programmes 
and those yet to start. Newcomers to the field can expect to progress more quickly than 
they might have in its absence. They can benefit from work already advanced and be 
assured that the outputs of their efforts will be as comparable as possible to those of other 
countries. 

It is envisaged that as work continues, the Guide will develop and improve in order to 
better serve the needs of OECD member countries and the international community at 
large. 
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Users of the Guide 

Official statisticians form the heart of the intended audience of this Guide. Its content 
is intended to assist in the consistent application of concepts and definitions, as well as the 
collection of comparable data via statistical surveys. 

There are other users too, of course, and they include: 

• Analysts who interpret the statistical information provided by statisticians will benefit 
by having insights into the standards that underlie that information. 

• Policy makers and governments are members of the user community for the proposed 
Guide. They were quick to try to find appropriate responses to developments associated 
with ICT and form a major part of the demand for information. 

• Businesses are also likely users. More than ever, in a period of widespread technological 
evolution, benchmarking is important as a means of assessing comparative performance 
and strategy. This is true both at the industry and firm level. 

• Researchers in many disciplines are active in this new area too. In particular, those 
involved in measuring ICT will benefit from the dissemination of statistical standards; and 

• Finally, international organisations, whose information requirements centre on 
comparability across countries, are expected to make good use of this Guide. 

Scope and content of the Guide 

The Guide broadly covers measurement of the information society as outlined in 
Figure 1.1. above, but does not attempt to detail all aspects of it. It focuses most attention 
on the work done by the OECD's WPIIS, including definition of the ICT and Content and 
media sectors and their products; measurement of ICT use by households/individuals and 
businesses; as well as work on the definition and measurement of e-commerce. It includes 
WPIIS work undertaken on e-business measurement, e-government, trust in the online 
environment and ICT investment. It also covers other selected work on ICT measurement, 
from within the OECD and elsewhere, including: infrastructure, prices, patents, digital 
content, the digital diuide, skills, education, occupations, and impacts of ICT. 

It is clear from Figure 1.1. that, while measurement and analysis are applicable to 
every aspect of the information society, the statistical information and methodologies 
involved are diverse. In recognition of this, the WPIIS has adopted a pragmatic approach, 
where priority and statistical feasibility determine the order in which information society 
issues are examined. Priorities are set in close collaboration with data users - particularly 
policy makers. Through the same process, components of interest will continue to be 
added and revised. Future outputs of the WPIIS and others will be incorporated into 
subsequent revisions of this Guide. 

Following this introductory chapter, the contents of the Guide are organised as follows: 

• Chapter 2 - ICT products - describes definitions and classifications relating to ICT goods 
and services, measurement of international trade in ICT goods, and the price and quality 
of ICT products. 

• Chapter 3 - ICT infrastructure - addresses the infrastructure of the information 
society - access services, their quality, investment in such services, and tariffs. 

• Chapter 4 - ICT supply - deals with the supply side of ICT, namely the ICT sector, its 
impacts, other ICT-producing entities, and ICT patenting activity. 



16 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



1. INTRODUCTION 



• Chapter 5 - ICT demand by businesses - describes the OECD model survey of ICT use 
by businesses and includes definitions and discussion of statistical standards for 
e-business and e-commerce. It also looks at the topics of ICT investment and 
expenditure by business, and the economic impacts of ICT investment and use. 

• Chapter 6 - ICT demand by households and individuals - describes the OECD model 
survey of ICT access and use by households and individuals. It also includes discussion 
of e-commerce and the social and economic impacts of ICT use by households and 
individuals. 

• Chapter 7 - Content - describes statistical issues relating to information and electronic 
content and more recent work on defining a Content and media sector and its products. 

• Chapter 8 - The road ahead - concludes with an examination of the international scene 
and future challenges. 

Output: Publication of information society statistics 

In parallel with development of standards for measuring the information society, the 
OECD has been publishing comparable statistics based on those standards. Many, but not 
all of those statistics, have been based on standards developed by the WPIIS. Others have 
included ICT infrastructure, ICT skills and ICT patent statistics. The following paragraph 
briefly describes the more important OECD published outputs on the information society. 

The regular OECD publications containing information society statistics are the 
Communications Outloofe (iuiuu;.oecd.org/sh7teIecom/outloofe), the Information Technology Outlook 
(www. oecd.org/sti/ito to be replaced by the Internet Economy Outloofe as of 2012), and the 
Science, Technology and Industry Scoreboard (www. oecd.org/sti/scoreboard). They are usually 
published biennially, and each series began in the early to mid-1990s. 

At the end of 2004, OECD introduced Key ICT Indicators, an online compilation of 
selected ICT indicators. Data are updated on a rolling basis and can be found at 
ui ujiu.oecd.org/sti/ICTindicators. 
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Chapter 2 



ICT Products 



This chapter describes definitions and classifications relating to ICT goods and 
services, measurement of international trade in ICT goods, and the price and quality 
of ICT products. 



2. ICT PRODUCTS 



Introduction 

Product statistics and associated classifications play an important role in basic 
economic analysis. In relation to ICT, the measurement of consumption, domestic 
production, market size, investments and trade all potentially make use of ICT product 1 
data, which includes statistics on: 

• international trade in ICT goods and services; 

• household expenditure on ICT goods and services; 

• business and government current and capital expenditure on ICT goods and services; and 

• domestic production of ICT goods and services. 

In order to compile statistics on ICT products, statisticians require definitions and 
classifications. The guiding principles for defining ICT products are based on those for the 
ICT sector (see Chapter 4). This is reasonable since the latter concept is based on 
characteristics of products rather than industries. The ICT sector definition was revised in 
2006-07, leading to a definition of its products as follows (OECD, 2008): 

"ICT products must primarily be intended to fulfil or enable the function of information 
processing and communication by electronic means, including transmission and 
display." 

The difficulties in establishing a classification of ICT products had been recognised by 
the WPIIS since 1998. These difficulties are related to the rapidly changing character of ICT 
goods and services, challenges in relating the definition to available classifications and the 
dated nature of product classifications such as the United Nations Central Product 
Classification (CPC). 2 

An ICT goods classification based on the Harmonized System used for trade statistics 
was first agreed by OECD member countries in 2003. It was revised by WPIIS in 2008 and 
was based on subclasses of the 2008 Central Product Classification, Version 2 (UNSD, 2008). 
A proposal for a classification of ICT services, based on an earlier draft of the CPC Ver. 2, 
had been agreed by WPIIS in 2006 (OECD, 2006). During preparation of the ICT goods 
classification based on the CPC Ver. 2, the ICT services classification was reviewed and 
amended, resulting in a single ICT product classification. Details of the changes made can 
be found in Annex 2.A1. 

This chapter was revised in 2007, 2009 and 2010, with the main changes reflecting the 
finalisation of an ICT product classification based on the United Nations Central Product 
Classification Version 2 (2008) and a correspondence between the goods component of the 
2008 ICT product classification and the 2007 Harmonized System (HS), necessary in order 
to apply the classification to trade statistics, declassified in 2010. Note that the Section, The 
price and quality of ICT products has not been revised. 
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The ICT product classification 

A history of WPIIS work on developing ICT product classifications can be found in 
Annex 2.A1. In respect of goods, the main changes between the ICT goods classification of 
2003 and the goods component of the ICT product classification of 2008 were: 

• the change in the underlying classification (from the HS to the CPC); and 

• a narrowing of scope, consistent with the changes to the definition of the ICT sector, to 
remove from the definition goods that "... use electronic processing to detect, measure 
and/or record physical phenomena or to control a physical process" (see Chapter 4 and 
Annex 7.A1 for more information). 

The main features of the 2008 ICT product classification, and its relationship with both 
the ICT sector definition and the Content and media product classification, can be 
summarised as follows (OECD, 2008): 

• One product of the ICT manufacturing industry 3 was excluded from the classification. 
Four products that are linked to an ICT and a non-ICT manufacturing industry, and two 
products with one link (of several) to an ICT manufacturing industry, were also 
excluded. 

• Two goods that are not products of an ICT industry were included in the classification 
based on strong majority support and for consistency with other inclusions. They are 
Digital cameras and Other recording media, including matrices and masters for the production of 
disks. 

• All of the products of ICT service industries are in either the ICT or the Content and 
media product classification. 

• Four ICT services were included in the Content and media product classification because 
the expert group considered that they are more similar to content than ICT They are the 
three games software products and Web search portal content. 

• A small number of services that are not products of ICT industries were included in the 
ICT product classification for consistency. They are: three leasing or rental services, 
Business process management services, Engineering services for telecommunications and 
broadcasting projects and two ICT installation services. 

• The ICT product classification does not have a specific goods/services split (though, for 
trade statistics purposes, it is clear which products are goods). 

In respect of ICT services, a classification based on an early draft of the CPC Ver. 2 was 
released in early 2007 and later revised when a complete ICT products classification was 
developed. The changes are explained in some detail in Annex 2.A1. 

Annex 2.A1 contains the full list of ICT products and groups them into the broad 
categories shown in Table 2.1 below. 

This broad structure plays an important role in the usefulness of the classification. It 
is hoped that the structure will allow grouping of product data into broad categories that 
will be publishable by member countries. 
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Table 2.1. Broad level categories for ICT products 



Broad level categories 


Number of CPC subclasses 
(products) 


Computers and peripheral equipment 


19 


Communication equipment 8 


Consumer electronic equipment 


11 


Miscellaneous ICT components and goods 


14 


Manufacturing services for ICT equipment 


5 


Business and productivity software and licensing services 


11 


Information technology consultancy and services 


10 


Telecommunications services 


12 


Leasing or rental services for ICT equipment 


3 


Other ICT services 


6 


Total 


99 



International trade in ICT products 

The 2003 classification of ICT goods was based on the international Harmonized 
System classification of traded goods (HS). It was therefore relatively easy to measure trade 
in ICT goods using available trade statistics (for example, from the OECD's International 
Trade in Commodity Statistics Database or the UN's Comtrade Database (UNSD, 2009)). 

With the revision of ICT products, this simple link no longer exists. A correspondence 
between the goods component of the 2008 ICT product classification and the 2007 
Harmonized System (HS) is necessary in order to apply the classification to trade statistics. 
This correspondence was prepared by WPIIS in 2010 and declassified by the Committee for 
Information, Computer and Communications Policy (ICCP) in October 2010. This provides 
countries with a revised classification for measuring trade in ICT goods. 

Annex 2.A1 contains the correspondence table between the CPC Ver. 2, HS 2007 and HS 
2002 classifications for ICT goods. 

Because the scope of ICT goods has narrowed compared with 2003 (see discussion 
above), there will be a break in the time series of ICT trade data. 

Data on trade in ICT services are currently limited in their detail compared with data 
on trade in ICT goods. A revised Manual on Statistics of International Trade in Services is due to 
be released in 2010 and is expected to include a slightly more detailed classification of ICT 
services. The current services classification used by UNSD in its UN Service Trade Database 
is the Extended Balance of Payments Services classification (EBOPS), which includes 
Computer services and Telecommunications services. 

The price and quality of ICT products 

The report of the meeting of the 2002 IAOS Conference Ofjirial Statistics and the New 
Economy (ONS, 2002) identified measurement methodologies relating to the price and 
quality of ICT products as among the most pressing issues in the field of new economy 
measurement. 

While this is an area not directly examined by the WPIIS, it is a topic that concerns 
OECD, NSOs and other groups such as the Voorburg Group on Services Statistics. 

For a brief overview of the conceptual issues relating to the price and quality of ICT 
products, readers are referred to work by Ahmad, Schreyer and Wolfl (2004) and Pilat, 
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Ahmad and Schreyer (2004). These papers summarise the challenges involved in 
constructing price indices for ICT products, which include: 

• incorporating the rapid price fall and quality increase of ICT components since about the 
mid-1990s; 

• the use of hedonic functions that link the price of ICT equipment and software to quality 
characteristics (such as speed and memory); and 

• differences between price indices of the three types of software - own account, 
customised and pre-packaged. 

A more detailed OECD study on hedonic indexes, Handbook on Hedonic Indexes and 
Quality Adjustments in Price Indexes: Special Application to Information Technology Products, was 
published in late 2004 (Triplett, 2004). The Handbook was the result of work undertaken by 
Jack Triplett of the Brookings Institution for the OECD. For the benefit of readers, extracts 
of relevant parts of the paper have been included as a short article below. 

Hedonic indexes and quality adjustments in price indexes for IT products 

Introduction 

The objective of the Handbook on Hedonic Indexes and Quality Adjustments in Price Indexes: 
Special Application to in/ormation Technology Products is to "contribute to a better 
understanding of the merits and shortcomings of conventional and hedonic methods, and 
to provide an analytic basis for choosing among them". It compares and contrasts the logic 
and statistical properties of hedonic methods and conventional methods and the results of 
employing them in different circumstances. In Chapter IV, it reviews empirical evidence on 
the difference that alternative methods make in practice, and offers an evaluation 
framework for determining which is better. In Chapters III, V, and VI, the handbook sets out 
principles for "best practice" hedonic indexes. These principles are drawn from experience 
with hedonic studies on a wide variety of products. Although most of the examples in the 
handbook are drawn from ICT products, the principles in it are very general and apply as 
well to price indexes for non-ICT products that experience rapid quality change, and also 
to price indexes for services, which are affected by quality changes fully as much as price 
indexes for goods. Some objections that have been raised to hedonic indexes are presented 
and analysed in Chapter VII. An appendix discusses issues of price index theory that apply 
to quality change, and presents the economic theory of hedonic functions and hedonic 
price indexes. 

The Handbook project was initiated by the Statistical Working Party of the OECD's 
Industry Committee. 4 Its objectives are to: 

• provide an accessible guide to the different approaches towards constructing ICT 
deflators, to permit officials involved in producing and using them to make informed 
choices; 

• discuss, in particular, some of the arguments that have surrounded the construction and 
use of hedonic methods in deriving price indices and compare them with more 
traditional practices; and 

• improve international harmonisation by increasing transparency about different 
country practices in this field and by providing methodological guidance for new work. 

Deflators for output, input, and investment - for producing productivity measures or 
value added in national accounts - are derived primarily from price indexes estimated by 
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statistical agencies. Whether the deflators are consumer (retail) price indexes (CPI or RPI) 
or producer (wholesale) price indexes (PPI or WPI), quality change has long been recognised 
as perhaps the most serious measurement problem in estimating price indexes. 

In national accounts, any error in the deflators creates an exactly equivalent error of 
opposite sign in the real output, real input, real investment and real consumption 
measures (which are referred to in the Handbook as "quantity indexes"). For this reason, 
discussing the problems posed by quality change in price indexes is the same thing as 
discussing the problems of quality change in quantity indexes, and therefore in measures 
of productivity change as well. 

Different quality adjustment methodologies are employed for ICT products across 
OECD countries, and they seemingly make large differences in the trends of price 
movements for these products. A Eurostat Task Force (Eurostat, 1999), reviewing ICT 
indexes for the early 1990s, found a smaller dispersion among European countries' ICT 
deflators. But still, price declines recorded by national computer deflators in Europe ranged 
from 10% to 47%, and again, the largest price decline was based on a hedonic price index 
(France). The Task Force calculated that price variation in this range could affect GDP 
growth rates by as much as 0.2%-0.3% per year, depending on the size of a country's ICT 
sector. International comparisons of productivity growth would be affected by 
approximately the same magnitude. 

If different quality adjustment procedures among OECD countries make the data non 
comparable, then the measured growth of ICT investment and of ICT capital stocks will not 
be comparable either. Data non-comparability for ICT deflators, investment and capital 
stocks therefore creates serious limitations to making international comparisons of 
economic growth and understanding international differences in productivity trends and 
levels and sources of growth. When ICT data are not internationally comparable, estimates 
of the impact of ICT on economic growth in different OECD countries have limited, if any, 
meaningfulness. 

The Handbook reviews the methods employed in price indexes to adjust for quality 
change. A natural division is between "conventional" methods typically employed by the 
statistical agencies of many OECD countries (discussed in Chapter II), and hedonic 
methods for adjusting for quality change (alternatively known as hedonic price indexes). 
The latter have a prominent place in price indexes for ICT products in several OECD 
countries. Hedonic methods for producing quality-adjusted price indexes are reviewed in 
Chapter III. The Handbook also sets out principles for "best practice" hedonic indexes (in 
Chapters III, V, and VI). These principles are drawn from experience with hedonic studies 
on a wide variety of products. 

Conventional price index methodology 

Agencies that estimate price indexes employ, nearly universally, one fundamental 
methodological principle. The agency chooses a sample of sellers (retail outlets in the case of 
consumer price indexes, or CPIs, producers for producer price indexes, or PPIs) and of 
products. It collects a price in the initial period for each of the products selected. Then, at 
some second period, it collects the price for exactly the same product, from the same seller, 
that was selected in the initial period. The price index is computed by matching the price for 
the second period with the initial price, observation by observation, or "model by model". 

The full rationale for this "matched model" methodology is seldom explicitly stated, 
and its advantages are not always fully appreciated. Matching, it is well known, is a device 
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for holding constant the quality of the goods and services priced for the index. Indeed, one 
significant source of price index error occurs when the matching methodology breaks 
down for some reason - some undetected change in the product makes the match inexact 
or the product observed in the initial period disappears and cannot be matched in the 
second. These situations impart quality change errors into the ostensibly matched price 
comparisons. Analysis of quality change errors is a major topic of the Handbook. 

Another aspect of the matched model methodology is less commonly perceived. 
Matching also holds constant many other price determining factors that are usually not 
directly observable. For example, matching on sellers holds constant, approximately, 
retailer characteristics such as customer service, location, or in-store amenities for CPI 
price quotations. For the PPI, matching holds constant, again approximately, unobserved 
reliability of the product, the reputation of the manufacturer for after-market service, 
willingness to put defects right or to respond to implicit warranties, and so forth. Although 
controlling for quality change is one of its objectives, matching the price quotes model by 
model is not just a methodology for holding quality constant in the items selected for pricing. 
It is also a methodology for holding constant non-observable aspects of the transactions 
that might otherwise bias the measure of price change. 

The problem of quality change potentially arises in price indexes whenever 
transactions are not homogeneous. It thus affects all price indexes, not just price indexes 
for high technology products, or price indexes for goods and services that are thought, by 
some measure, to experience rapid quality change. Even if the product is homogeneous, 
transactions are not homogeneous and it is transactions that matter in a price index. The 
matched model method is a device that is intended to hold constant the characteristics of 
transactions. 

Moreover, buyers switch from one seller to another in search of a more favourable 
price/service combination. For example, personal computers (PCs) are increasingly sold 
over the Internet, rather than in retail computer stores. Consumers on average evidently 
value the retailing services provided by "brick and mortar" stores by less than the price 
differential between them and online sellers. When buyers switch between distribution 
outlets, they may experience true price changes that are more favourable than the ones 
that the matched model, matched-outlet method measures. 

Some methods that have been proposed for computing quality-adjusted price indexes 
imply modifying or replacing the matched model methodology. Price index agencies have 
been reluctant to adopt alternatives that require abandoning the matched model 
methodology. 

Hedonic price index methodology 

According to the Handbook "A hedonic price index is any price index that makes use of a 
hedonic /unction. A hedonic function is a relation between the prices of different varieties of a 
product, such as the various models of personal computers, and the quantities of 
characteristics in them." As implied by this definition, hedonic indexes may be computed in 
a number of ways. For example, a hedonic function for computer equipment is typically 
estimated using an ordinary least squares regression and describes a relationship between, 
at a minimum, price, speed and memory. 

Four major methods of calculating hedonic price indexes have been developed for 
estimating ICT price indexes. Each of these methods uses a different kind of information 
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from the hedonic function. The first two described in the Handbook (the "time dummy 
variable method" and the "characteristics price index method") are sometimes referred to 
as "direct" methods, because all their price information comes from the hedonic function; 
no prices come from an alternative source. Direct methods require that a hedonic function 
be estimated for each period for which a price index is needed. 

The second two hedonic price index methods (the "hedonic price imputation method" 
and the "hedonic quality adjustment method") have been described as "indirect" or 
"composite" methods. They are often called "imputation" methods, because the hedonic 
function is used only to impute prices or to adjust for quality changes in the sample of 
computers in cases where matched comparisons break down. The rest of the index is 
computed according to conventional matched model methods, using the prices that are 
collected in the statistical agency's usual sample. 

The Handbook describes the four methods in detail and compares them with each 
other and with conventional methods. In practice, statistical agencies that have 
implemented hedonic indexes have mostly used the hedonic quality adjustment method, 
partly because of the necessity for producing a timely index. The hedonic quality 
adjustment method can be estimated using a hedonic function from a prior period, where 
the dummy variable method (and other methods) requires the current period's hedonic 
function as well. But there is no reason why the dummy variable method should not be 
employed when it is feasible. Its major liability is the difficulty in introducing weights into 
the dummy variable index. 

For more information, readers are referred to the Handbook, available on line at: 
iuiuiu.oecd.org/dataoecd/37/31/33789552.pd/. 

Notes 

1. "Product" refers to both goods and services. An alternative term for "product" which is sometimes 
used is "commodity". 

2. This is less of an issue for the 2008 version of the ICT product classification as it is based on the 
CPC Version 2, completed in 2008. 

3. A product is taken to be a product of an industry if its CPC code (subclass) is linked (in the CPC) to 
the ISIC class representing that industry. 

4. Now the Committee on Industry, Innovation and Entrepreneurship (CUE). 
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ANNEX 2.A1 



OECD Classifications of Information Economy Products 

Introduction 

The OECD information economy product classifications have been developed in 
stages, commencing with an ICT goods classification in 2003. In 2006, the first ICT services 
classification was released and in late 2008, a complete set of information economy 
products, based on the Central Product Classification Ver. 2 was agreed (OECD, 2008). It was 
revised slightly in January 2009 because of a number of small changes made to the 
underlying classification (the CPC Ver. 2) in late 2008. In 2010, a correspondence table 
between the CPC Ver. 2, HS 2007 (World Customs Organization, 2007) and HS 2002 
classifications for ICT goods was agreed. 

This annex includes the ICT and Content and media product classifications agreed in 
2008 and finalised in early 2009. They are based on the final version of the United Nations 
Central Product Classification Ver. 2. Also included is a correspondence table between the 
CPC Ver. 2, HS 2007 and HS 2002 classifications for ICT goods finalised in 2010. 

The 2008 CPC list includes both ICT products and Content and media products. Both lists 
include goods as well as services. 

As Figure 2.A1.1 illustrates, the information economy classifications were developed 
separately - and at different times. The main reasons for this were: 

• the lack of appropriate international standard classifications; in particular an ICT 
services classification only became possible once the CPC Ver. 2 was developed; and 

• the lack of an agreed definition of the Content and media sector and associated guiding 
principles effectively prevented development of a classification of content and media 
products until 2006; in addition, the underlying product classification, the CPC, was not 
sufficiently detailed to support the classification until Ver. 2 was developed. 

Figure 2.A1.1 provides a diagrammatic representation of the sector and product 
information economy definitions and classifications produced by WPIIS over time. Note, a 
split between ICT goods and services is shown in this diagram for comparative purposes. 
However, there is no actual split in the ICT product definition. 
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Figure 2.A1.1. OECD information economy sectoral and product definitions 



Year 



Sectoral definitions 



Product definitions 



1998 



2002 



2003 



2007 



2008 



2010 



First ICT sector 

definition 
(based on ISIC 
Rev. 3) 



Revised ICT 
sector definition 
(based on ISIC 
Rev. 3.1) 



Second ICT 
sector definition 
(based on a late 
draft of ISIC Rev. 4) 



First content 
and media sector 
def. (based on a late 
draft of ISIC Rev. 4) 



First ICT goods 
classification 
(based on HS 
1996/2002) 



First ICT services 

classification 
(based on an early 
draft ofCPCVer. 2) 



First content and 
media product class 

(based on a late 
draft ofCPCVer. 2) 



Revisions to 2007 
ICT services (based 
on a late draft of 
CPCVer. 2) 



Second ICT good 
classification (based 
on a late draft of 
CPCVer. 2) 



ICT product classification 



Information economy product classifications 



Information economy product classifications 
(Correspondence: CPC Ver.2 HS 2007 - HS 2002) 



Source : OECD, DSTI/EAS. 



ICT product classifications 

The words "list" and "definition" have also been used to describe the information 
economy product classifications. They are generally equivalent. In this Guide, "definition" 
in the context of product classifications has been used to describe the guiding principle, 
rather than the set of categories (which is described as a "classification"). 

ICT goods 

The main reason to have a classification of ICT goods is to facilitate the construction 
of internationally comparable indicators on ICT consumption, investment, trade and 
production. The first OECD classification of ICT goods was finalised in December 2003 
(OECD, 2003). It was limited to goods because, the only available international standard at 
that time, the UN's Central Product Classification (Ver. 1.1), made no mention of core ICT 
services such as web hosting and application provisioning. It may be found in the 2005 
edition of the Guide along with information on its development. 

WPIIS work on an ICT goods classification started in 1998. Several papers were written 
on this topic by Eurostat and discussed over the 1998-2000 period at meetings of the WPIIS. 
At its meeting in May 2003, the WPIIS discussed a revised list of ICT goods - presented by 
Canada. Comments made during and after the meeting were taken into consideration in 
drafting the final list. The draft list discussed at the May 2003 WPIIS meeting was expressed 
in terms of the Harmonized System (HS) 1996 classification. The final 2003 list was also 
expressed in terms of HS 2002. Only a small number of categories were affected by the 
change. The proposal was declassified by ICCP on 15 December 2003 (OECD, 2003). 

The guiding principles used to develop the 1998 ICT sector definition (and its revision 
of 2002) were applied to the 2003 ICT goods classification. This was appropriate given that 
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these principles emphasised the intended use or functionality of products. The guiding 
principle for the delineation of the ICT sector led to a definition of ICT goods as follows: 
"ICT goods must either be intended to fulfil the function of information processing and 
communication by electronic means, including transmission and display, or use 
electronic processing to detect, measure and/or record physical phenomena, or to 
control a physical process." 

Another guiding principle was to use existing classification systems in order to take 
advantage of existing data sets and therefore ensure the immediate use of the proposed 
standard. In this case, the underlying system was the widely used Harmonized System (HS) 
used for trade statistics. Table 2.A1.3. at the end of this annex shows a correspondence 
table between the CPC Ver. 2, HS 2007 and HS 2002 classifications for ICT goods finalised 
in 2010. 

The new list of ICT goods for trade analysis takes into account the new OECD 
definition of ICT products (2008) and the changes in the international classification of trade 
in goods (HS 2007). The list, developed by a WPIIS expert group was derestricted in 2010. 

After consultations an agreement on a common correspondence table and a common 
way to disaggregate the ICT goods groups was reached. The consensus was based on the 
following principles: 

• To use the 2008 definition of ICT products (Guide to Measuring the Information Society 2009) 
to analyse ICT goods trade for the period 1996-2008 and not to use the old 2003 definition 
anymore. 

• To use the HS 2007 and HS 2002 items lists to fit the CPC rev. 2 definition. To include the 
item "Video game consoles" [950410] to the HS 2007 and HS 2002 lists. It was agreed, 
following a discussion among the WPIIS Delegates, to include the item "Video game 
consoles" [950410] to the HS 2007 and HS 2002 ICT goods list. There were good arguments 
either to leave the item out of the ICT goods list or to include it. The argument to leave 
the item out of the ICT goods list was that Video game consoles have hardware and a 
software component. As the software component value will be greater than the 
hardware component it should be excluded from the ICT goods list and be classified only 
in the software list. The argument to include it in the ICT goods list was that Video game 
consoles are valuable goods which have complex connectivity functions which allow 
some models to connect to the Internet, access emails and read DVD in addition to play 
video games. These goods can be considered as converging media access devices. 

• To use the "block of items time series" concept as a solution to bridge the HS 2007 and HS 
2002 classifications. This procedure entails grouping items in the smallest group 
possible and concerns items where "one to one" correspondence is not possible because 
of "one to many", or "many to many" correspondences. 

• To split the former Group D - Miscellaneous into two groups: D - Electronic components 
and E-Miscellaneous. 

• To provide an estimate of the value of "old" ICT goods over the 1996-2008 period in order 
to reconcile the time series based on the old and the new definitions. 
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ICT services 

Complementing the 2003 ICT goods classification, there was an obvious need for an 
ICT services classification. In the case of service products, the most obvious international 
standard is the UN's Central Product Classification (CPC). 

At the WPIIS meeting of April 2004, Statistics Canada presented a proposal for an ICT 
services classification based on the North American Product Classification System (NAPCS) 
(OECD, 2004). The concept underlying the list of ICT industries was used to develop the list 
of ICT services. As for ICT goods, this is considered reasonable since the industry concept 
is based on characteristics of products. 

The 2004 WPIIS meeting agreed to forward the Canadian proposal to the United 
Nations Technical Subgroup (of the Expert Group on International Economic and Social 
Classifications), subject to minor changes, so that it could be taken into account for the 
2007 revision of the CPC. Most of the WPIIS proposed changes were adopted and included 
in a draft of the revised CPC that was circulated for comment in July 2005. The UN 
Statistical Commission adopted an amended structure at its March 2006 meeting, with the 
essence of the WPIIS proposal retained - except for software, which appears in different 
areas of the CPC, depending on its nature and mode of delivery. 

An ICT services classification based on an early draft version of the CPC Ver. 2 was 
developed in 2006 and released in 2007. It was subsequently amended in the course of 
development of a complete ICT products classification (which was based on a later version 
of the CPC Ver. 2). 

A complete set of information economy products 

The ICT sector definition was revised in 2006 (and released in 2007), when ISIC Rev. 4 
became available. A definition of a Content and media sector was developed in conjunction 
with the ICT sector, also based on ISIC Rev. 4. The information economy sectoral definitions 
can be found in Annex 7.A1. Agreement on the information economy sectors led the way 
to development of a set of information economy products. 

The same expert group that worked on the information economy sectoral definitions 
developed the product classifications, with some changes in membership. In respect of the 
principles used to determine the product lists, the assumption was made that products of 
the information economy sector should be included, and that products that are not output 
of the sector should be excluded, unless there is a compelling case for their exclusion/ 
inclusion respectively. A product is taken to be a product of an industry if its CPC Ver. 2 code 
(subclass) is linked (in the CPC) to the ISIC class representing that industry. 

Members of the expert group were amenable to taking a majority approach to reach 
agreement. A product was included where a strong majority view prevailed, irrespective of 
the corresponding industry. Where the majority was not so clear, other considerations 
were taken into account. 

The ICT product classification 

The following guiding principle was used to identify ICT products (it is adapted from 
the agreed guiding principle for the ICT sector): 

"ICT products must primarily be intended to fulfil or enable the function of information 
processing and communication by electronic means, including transmission and display." 
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The main features of the ICT product classification can be summarised as follows 
(OECD, 2008a): 

• One product of the ICT manufacturing industry was excluded from the ICT products list. 
It is Connectors for optical fibres, optical fibre bundles or cables and is linked to the ISIC 
class 2610 (Manufacture of electronic components and boards). The exclusion followed 
agreement by the expert group to exclude the related product Optical fibres and optical 
fibre bundles; optical fibre cables (except those made up of individually sheathed fibres), etc. 

• Four products that are linked to an ICT and a non-ICT manufacturing industry were 
excluded with the strong majority support of the expert group, and two products with 
one link (of several) to an ICT industry were also excluded. 

• Two goods that are not products of an ICT industry were included, based on strong 
majority support and for consistency with other inclusions. They are Digital cameras and 
Other recording media, including matrices and masters for the production of disks. 

• All of the products of ICT services industries are in either the ICT or the Content and 
media products list. 

• Several ICT services were included in the Content and media products list because the 
expert group considered that they are more similar to content than ICT. They are the 
three games software products (38582, 47822 and 84391) of ISIC class 5820 (Software 
publishing) and the web portals industry product, Web search portal content. 

• A small number of services that are not products of ICT industries were included in the 
ICT products list. They are: three ICT leasing or rental services, Business process 
management services, Engineering services for telecommunications and broadcasting projects 
and two ICT installation services. 

• The ICT product classification does not have a specific goods/services split (though for 
trade statistics purposes, it is clear which products are goods). 

The specific issues that arose during the expert group's deliberations on the ICT 
products list and their resolution were as follows: 

• ICT manufacturing services (where physical inputs are owned by others). These are 
shown as products of the relevant ICT manufacturing industries. The question of 
whether such services are ICT goods or services was debated but the issue was 
effectively resolved by including the five ICT manufacturing services subclasses in a 
broad category (Manufacturing services for ICT equipment) within the ICT product 
definition (that is, not splitting the ICT products list into ICT goods and ICT services). 

• Burglar or fire alarms and similar apparatus. There was some debate on the inclusion or 
exclusion of this product. It was ultimately included because it is a product of the ICT 
sector. 

• Exclusion of products with links to both ICT and a non-ICT industries. It was considered 
that such products should be included or excluded based on their nature rather than a 
link to an ICT industry. As a consequence, four products that are linked to an ICT and a 
non-ICT manufacturing industry were excluded, with strong majority support of the 
expert group. They are electrical capacitors, resistors and their parts. Two products with 
one link (of several) to an ICT industry have also been excluded. They are: Parts and 
accessories for the goods of subclasses 45141, 45142 and 45160 (except couers, carrying cases and 
the like) and Parts for the goods of subclasses 46910, 46921 and 46929; electrical parts n.e.c. of 
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machinery or apparatus (for both these subclasses, only one of the three cited products is 
an ICT product). 

• Inclusion of products without a link to ICT industries. Several goods were proposed as 
ICT products even though they are not products of the ICT sector. These products were 
debated by the expert group and most were ultimately excluded. The excluded products 
are the electrical apparatus product, 46212, and co-axial and optical fibre cables (46320 
and 46360 respectively). Two out-of-industry products were included in the list based on 
strong majority support. They are Digital cameras and Other recording media, including 
matrices and masters for the production of disks. 

• ICT installation services. Installation services of personal computers and peripheral equipment 
is a product of the ICT sector but was not included in the original ICT services definition. 
The expert group agreed to include it in the ICT product definition, along with two other 
installation services (covering installation of mainframe computers and radio, television 
and communications equipment) for consistency, even though these are not products of 
the ICT sector. 

• Maintenance and repair services of computers and peripheral equipment (87130) was included 
in the original ICT services definition but the related product Maintenance and repair 
seruices of telecommunication equipment and apparatus (87153) was not. Both are products of 
the ICT sector and the expert group agreed that they should both be in the ICT products 
list. The group was divided on whether to include 87155 Maintenance and repair services of 
consumer electronics, a product of ISIC class 9521 that was excluded from the ICT sector for 
largely pragmatic reasons. It was ultimately agreed to exclude it from the product 
classification given that it is an out-of-industry product and there was not strong 
support for its inclusion. 

• ICT leasing or rental services (subclasses 73123, 73124, 73125 and 73210). There are no 
corresponding industries in the ICT sector definition. However, 73123 and 73124 were 
included in the original ICT services classification. The inclusion of 73123 (Leasing or 
rental seruices concerning office machinery and equipment (excl. computers) without operator) 
was reviewed by the expert group and excluded because it was considered too broad. 
However, two other leasing or rental services were included (Leasing or rental seruices 
concerning telecommunications equipment without operator - 73125, and Leasing or rental 
seruices concerning teleuisions, radios, uideo cassette recorders and related equipment and 
accessories - 73210). 

• The expert group agreed to include Engineering seruices for telecommunications and 
broadcasting projects (83325) in the ICT product list (it is not a product of the ICT sector, 
nor included in the original ICT services classification). The group agreed to retain the 
subclass Business process management seruices (83117), which was in the original ICT 
services classification but is not a product of the ICT sector. 

• There are several wholesale trade services subclasses in the CPC that relate to ICT and 
Content and media products. None of these is included in the IE product classifications 
for the following reasons: the value of wholesale trade services will generally be included 
in the value of goods transactions; and it is likely that, statistically, wholesale trade 
services are not distinguishable by type. Retail trade services are excluded as well, in this 
case because retail trade industries are specifically excluded from the sectoral definitions. 

The ICT product classification has 10 broad categories and 99 products. Table 2.A1.1 
below shows the complete classification as revised in January 2009. 
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Table 2.A1.1. ICT products 



CPCVer. 2 subclass 


ISIC Rev. 4 class 


: Product description (CPC subclass title) 


Computers and peripheral equipment 


45142 


2620 


Point-of-sale terminals, ATMs and similar machines 


45221 


2620 


Portable automatic data processing machines weighing not more than 1 0 kg, such as laptop 
and notebook computers 


4R999 


9R9H 


Personal digital assistants and similar computers 




9R9H 


Automatic data processing machines, comprising in the same housing at least a central processing unit 
and an input and output unit, whether or not combined 


45240 


2620 


Automatic data processing machines presented in the form of systems 


45250 


2620 


Other automatic data processing machines whether or not containing in the same housing one or two 
of the following types of units: storage units, input units, output units 


45261 


2620 


Input peripherals (keyboard, joystick, mouse, etc.) 


45262 


2620 


Scanners (except combination of printer, scanner, copier and/or fax) 


45263 


2620 


Inkjet printers used with data processing machines 


45264 


2620 


Laser printers used with data processing machines 


45265 


2620 


Other printers used with data processing machines 


45266 


2620 


Units performing two or more of the following functions: printing, scanning, copying, faxing 


45269 


2620 


Other input or output peripheral devices 


45271 


2620 


Fixed media storage units 


45272 


2620 


Removable media storage units 


45289 


2620 


Other units of automatic data processing machines 


45290 


2620 


Parts and accessories of computing machines 


47315 


2620 


Monitors and projectors, principally used in an automatic data processing system 


47550 


2620 


Solid-state non-volatile storage devices 


Communication equipment 


46921 


2630 


Burglar or fire alarms and similar apparatus 


47211 


2630 


Transmission apparatus incorporating reception apparatus 


47212 


2630 


Transmission apparatus not incorporating reception apparatus 


47213 


2630 


Television cameras 


47221 


2630 


Line telephone sets with cordless handsets 


47222 


2630 


Telephones for cellular networks or for other wireless networks 


47223 


2610, 2630 


Other telephone sets and apparatus for transmission or reception of voice, images or other data, 
including apparatus for communication in a wired or wireless network (such as a local or wide area 
network) 


47401 


2630 


Parts for the goods of subclasses 47221 to 47223 


Consumer electronic equipment 


38581 


2640 


Video game consoles 


47214 


2640 


Video camera recorders 


47215 


2670 


Digital cameras 


47311 


2640 


Radio broadcast receivers (except of a kind used in motor vehicles), whether or not combined with 
sound recording or reproducing apparatus or a clock 


47312 


2640 


Radio broadcast receivers not capable of operating without an external source of power, of a kind used 
in motor vehicles 


47313 


2640 


Television receivers, whether or not combined with radio-broadcast receivers or sound or video 
recording or reproducing apparatus 


47314 


2640 


Monitors and projectors, not incorporating television reception apparatus and not principally used in an 
automatic data processing system 


47321 


2640 


Sound recording or reproducing apparatus 


47323 


2640 


Video recording or reproducing apparatus 


47330 


2640 


Microphones and stands therefor; loudspeakers; headphones, earphones and combined microphone/ 
speaker sets; audio-frequency electric amplifiers; electric sound amplifier sets 


47402 


2640 


Parts for the goods of subclasses 47321 , 47323 and 47330 


Miscellaneous ICT components and goods 


45281 


2610 


Sound, video, network and similar cards for automatic data processing machines 


47130 


2610 


Printed circuits 


47140 


2610 


Thermionic, cold cathode or photo-cathode valves and tubes (including cathode ray tubes) 
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Table 2.A1.1. ICT products (cont.) 



CPCVer. 2 subclass 


ISIC Rev. 4 class 


; Product description (CPC subclass title) 


/17^ c;n 
47160 


^bl U 
2610 


Diodes, transistors and similar serni-conductor devices; photosensitive semi-conductor devices; light 
emitting diodes; mounted piezo-electric crystals 
Electronic integrated circuits 


47173 


2610 


Parts for the goods of subclasses 47140 to 47160 


47403 


2630, 2640. 
2651 


Parts for the goods of subclasses 47211 to 47213,47311 to 47315 and 48220 


47530 


2680 


Magnetic media, not recorded, except cards with a magnetic stripe 


47540 


2680 


Optical media, not recorded 


47590 


3290 


Other recording media, including matrices and masters for the production of disks 


47910 


2680 


Cards with a magnetic stripe 


47920 


2610 


"Smart cards" 


48315 


2610,2670 


Liquid crystal devices n.e.c; lasers, except laser diodes; other optical appliances and instruments n.e.c. 


48354 


2610,2670 


Parts and accessories for the goods of subclass 4831 5 


Manufacturing services for ICT equipment 


88741 


2610 


Electronic component and board manufacturing services 


88742 


2620 


Computer and peripheral equipment manufacturing services 


88743 


2630 


Communication equipment manufacturing services 


88744 


2640 


Consumer electronics manufacturing services 


88749 


2680 


Magnetic and optical media manufacturing services 


Business and productivity software and licensing services 


47811 


5820 


Operating systems, packaged 


47812 


5820 


Network software, packaged 


47813 


5820 


Database management software, packaged 


47814 


5820 


Development tools and programming languages software, packaged 


47821 


5820 


General business productivity and home use applications, packaged 


47829 


5820 


Other application software, packaged 


73311 


5820 


Licensing services for the right to use computer software 


83143 


5820 


Software originals 


84341 


5820 


System software downloads 


84342 


5820 


Application software downloads 


84392 


5820 


On-line software 


Information technology consultancy and services 


83117 


7020 


Business process management services 


83131 


6202 


IT consulting services 


83132 


6202 


IT support services 


83141 


6201 


IT design and development services for applications 


83142 


6202 


IT design and development services for networks and systems 


83151 


6311 


Website hosting services 


83152 


6311 


Application service provisioning 


83159 


6311 


Other hosting and IT infrastructure provisioning services 


83161 


6202 


Network management services 


83162 


6202 


Computer systems management services 


Telecommunications services 


84110 


6110,6120 


Carrier services 


84121 


6110 


Fixed telephony services - access and use 


84122 


6110 


Fixed telephony services - calling features 


84131 


6120,6130 


Mobile telecommunications services - access and use 


84132 


6120,6130 


Mobile telecommunications services - calling features 


84140 


6110, 6120, 
6130,6190 


Private network services 


84150 


6110, 6120, 
6130,6190 


Data transmission services 


84190 


6110, 6120, 
6130,6190 


Other telecommunications services 


84210 


6110 


Internet backbone services 
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CPC Ver. 2 subclass ISIC Rev. 4 class Product description (CPC subclass title) 



84221 6110,6120, Narrowband Internet access services 
6130,6190 

84222 6110,6120, Broadband Internet access services 
6130,6190 

84290 6110,6120, Other Internet telecommunications services 

6130,6190 

Leasing or rental services for ICT equipment 

73124 7730 Leasing or rental services concerning computers without operator 

73125 7730 Leasing or rental services concerning telecommunications equipment without operator 
73210 7729 Leasing or rental services concerning televisions, radios, video cassette recorders and related 

equipment and accessories 

Other ICT services 

83325 7110 Engineering services for telecommunications and broadcasting projects 

87130 9511 Maintenance and repair services ot computers and peripheral equipment 

87153 9512 Maintenance and repair services of telecommunication equipment and apparatus 

87331 3320 Installation services of mainframe computers 

87332 6209 Installation services of personal computers and peripheral equipment 

87340 3320 Installation services of radio, television and communications equipment and apparatus 



Note: The CPC codes, titles and ISIC links presented above are from the 31 December 2008 version of the Central 
Product Classification (Ver. 2). In the unlikely case of further changes to the CPC, the final official codes, titles and 
ISIC links will prevail. 

The Content and media product classification 

The following guiding principle was used to identify Content and media products 
(adapted from the definition used to determine the Content and media sector): 

Content corresponds to an organised message intended for human beings published 
in mass communication media and related media activities. The value of such a product to 
the consumer does not lie in its tangible qualities but in its information, educational, cultural 
or entertainment content. 

The main features of the Content and media products classification can be 
summarised as follows (OECD, 2008): 

• All of the products of the Content and media sector were included in the list. 

• Four products of the ICT sector were included in the Content and media products list. 
They are the three games software products and, the product, Web search portal content 
(see ICT products for details). 

• Four products that are not from the Content and media (nor ICT) sector were included in 
the Content and media products list based on majority support and consistency 
arguments. 

The specific issues that arose during the expert group's deliberations on the Content 
and media products list and their resolution were as follows: 

• The inclusion of ICT sector products in the Content and media products list. Four 
products of the ICT sector were included in the Content and media products list, with the 
strong agreement of expert group members. The three games software products (38582, 
47822 and 84391) are products of ISIC class 5820 (Software publishing). The expert group 
agreed that such software is more similar to content than ICT The ICT sector product, 
Web search portal content was included in the Content and media product list as it is 
considered to be a content, rather than an ICT, product. 
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• The interpretation of the term "related media activity" in the guiding principle. This 
covered products such as "sale of advertising space" and "licensing services". Most are 
products of the Content and media sector and were included in the classification. Three 
products that are not from the Content and media (nor ICT) sector were included, for 
consistency. They are: Full service advertising and Purchase or sale of advertising space or 
time, on commission (both products of 7310, Advertising), and Advertising and related 
photography services, which is a product of 7420 (Photographic activities). 

• Whether some of the products of 5819 Other publishing activities complied with the 
guiding principle, that is whether they are an "... organised message intended for human 
beings published in mass communication media Ultimately, all of these products 
were included. 

• Leasing or rental services concerning video tapes and disks (subclass 73220). There is no 
corresponding industry in the Content and media sector and the group thought that the 
product is equivalent to a retail service so excluded it from the Content and media 
products list. 

• Originals. There are several products in the CPC that can be described as "content originals". 
These constitute the original source of "content" and most have been included. Those 
excluded were not products of the Content and media sector and were considered marginal 
by the expert group (the products: Photographic plates, Jilm, paper, paperboard and textiles, exposed 
but not developed, Photographic plates and jilm, exposed and developed, other than cinematographic 
film; and Paintings, drawings and pastels; original engravings, prints and lithographs; original 
sculptures and statuary, in any material). One original product that is not a product of the 
Content and media sector has been included - Original works of authors, composers and other 
artists except performing artists, painters and sculptors, a product of ISIC class 9000. 

• Wholesale and retail trade services relating to Content and media products were 
excluded. See the discussion under ICT products above. 

The Content and media product classification has six broad level categories and 
74 products. Table 2.A1.2. below shows the complete classification as revised in January 2009. 



Table 2.A1.2. Content and media products 



CPC Ver. 2 subclass 


ISIC Rev. 4 class 


Product description (CPC subclass title) 


Printed and other text-based content on 


physical media, and related services 


32210 
32220 


5811 
5811 


Educational textbooks, in print 
General reference books, in print 


32230 


5812 


Directories, in print 


32291 


5811 


Professional, technical and scholarly books, in print 


32292 


5811 


Children's books, in print 


32299 


5811 


Other books n.e.c, in print 


32300 


5813 


Newspapers and periodicals, daily, in print 


32410 


5813 


General interest newspapers and periodicals, other than daily, in print 


32420 
32490 


5813 
5813 


Business, professional or academic newspapers and periodicals, other than daily, in print 
Other newspapers and periodicals, other than daily, in print 


32511 


5811 


Maps and hydrographic or similar charts (including wall maps, topographical plans and maps for 
globes), printed, other than in book-form 


32530 


5819 


Printed or illustrated postcards; printed cards bearing personal greetings or messages, with or without 
envelopes or trimmings 


32540 


5819 


Printed pictures, designs and photographs 


32620 


5819 


Trade advertising material, commercial catalogues and the like 
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Table 2.A1.2. Content and media products (cont.) 

CPC Ver. 2 subclass ISIC Rev. 4 class Product description (CPC subclass title) 

32630 5819 Transfers (decalcomanias) and printed calendars 

47691 5811 Audio books on disk, tape or other physical media 

47692 5811,5812, Text-based disks, tapes or other physical media 

5813 

83631 5812, 5813 Sale of advertising space in print media (except on commission) 
Motion picture, video, television and radio content, and related services 

38950 591 1 Motion picture film, exposed and developed, whether or not incorporating sound track or consisting only 

of sound track 

47620 591 1 Films and other video content on disks, tape or other physical media 

83632 601 0, 6020 Sale of TV/radio advertising time (except on commission) 

84611 6010 Radio broadcast originals 

84612 6020 Television broadcast originals 

84621 6010 Radio channel programmes 

84622 6020 Television channel programmes 

84631 6010,6020 Broadcasting services 

84632 6010, 6020 Home programme distribution services, basic programming package 

84633 6010, 6020 Home programme distribution services, discretionary programming package 

84634 6010,6020 Home programme distribution services, pay-per-view 

96121 5911, 6020 Motion picture, videotape and television programme production services 

96122 5920,6010 Radio programme production services 

96123 591 1 , 5920 Motion picture, videotape, television and radio programme originals 

96131 5912 Audiovisual editing services 

96132 5912 Transfers and duplication of masters services 

96133 5912 Colour correction and digital restoration services 

96134 5912 Visual effects services 

96135 5912 Animation services 

96136 5912 Captioning, titling and subtitling services 

96137 5920 Sound editing and design services 

96139 5912 Other post-production services 

96140 5913 Motion picture, videotape and television programme distribution services 
96150 5914 Motion picture projection services 

Music content and related services 

32520 5920 Music, printed or in manuscript 

47610 5920 Musical audio disks, tapes or other physical media 

96111 5920 Sound recording services 

96112 5920 Live recording services 

96113 5920 Sound recording originals 
Games software 

38582 5820 Software cartridges for video game consoles 

47822 5820 Computer game software, packaged 

84391 5820 On-line games 
On-line content and related services 

73312 5812 Licensing services for the right to use databases 

83633 5813,5819,6311, 

6312 Sale of Internet advertising space (except on commission) 

84311 5811 On-line books 

84312 5813 On-line newspapers and periodicals 

84313 5812 On-line directories and mailing lists 

84321 5920 Musical audio downloads 

84322 5920 Streamed audio content 

84331 5911 Films and other video downloads 

84332 5911 Streamed video content 
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Table 2.A1.2. Content and media products (cont.) 



CPC Ver. 2 subclass 


ISIC Rev. 4 class 


Product description (CPC subclass title) 


84393 


5819 


On-line adult content 


84394 


6312 


Web search portal content 


84399 


5819 


Other on-line content n.e.c. 


Other content and related services 


47699 


5920 


Other non-musical audio disks and tapes 


73320 


5811,5813,5911, 


Licensing services for the right to use entertainment, literary or artistic originals 




5912,5920, 9000 




83611 


7310 


Full service advertising 


83620 


7310 


Purchase or sale of advertising space or time, on commission 


83639 


5811,5812, 7310 


Sale of other advertising space or time (except on commission) 


83812 


7420 


Advertising and related photography services 


83940 


5812 


Original compilations of facts/information 


84410 


6391 


News agency services to newspapers and periodicals 


84420 


6391 


News agency services to audiovisual media 


85991 


6399 


Other information services 


89110 


5811,5812, 5813, 


Publishing, on a fee or contract basis 




5819, 5820, 5920 




96330 


9000 


Original works of authors, composers and other artists except performing artists, painters and sculptors 



Note: The CPC codes, titles and ISIC links presented above are from the December 2008 version of the Central Product 
Classification, Version 2 (UNSD, 2008). In the unlikely case of further changes to the CPC, the final official codes, titles 
and ISIC links will prevail. 
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Introduction 

In the late 1980s, the OECD started work on defining performance indicators for the 
telecommunication industry, with the aim of enabling international comparison and 
informing policy. The report Performance Indicators for Public Telecommunications Operators 
(OECD, 1990) summarised the initial set of indicators used by the OECD to compare the 
development of telecommunication services in member countries. The report also 
included a summary of the initial OECD methodology for comparing telecommunication 
tariffs. This methodology formed the basis for analysing the telecommunication sector in 
the biennial Communications Outlook (OECD, 1991 onwards). 

The International Telecommunication Union's (ITU) De/initions of World 
Telecommunication/ICT Indicators (ITU, 2007 and 2010) identifies and defines key 
telecommunication/ICT indicators for analysing the sector (e.g. number of fixed telephone 
lines, mobile cellular subscriptions, fixed Internet subscriptions, etc). 1 Its goal is to assist 
the standardisation of statistics in order to improve analysis and comparisons within and 
across countries and telecommunication operators. Given that the telecommunication/ICT 
sector continues to change rapidly, the indicators to measure the telecommunication/ICT 
sector need to be adapted regularly. The impressive growth and changes in the mobile and 
Internet sectors over the last few years, for example, have called for the revision of existing 
definitions. These changes are discussed and the indicators considered and adopted at the 
ITU's World Telecommunication/ICT Indicators Meeting (WTIM), which is organised 
regularly. Following the 7th WTIM in 2009, an Expert Group on Telecommunication/ICT 
Indicators (EGTI) was created to revise the ITU telecommunication/ICT indicators and their 
definitions. At a meeting of the EGTI in March 2010, revisions were finalised for more than 
160 indicators. One of the main objectives was to harmonise the definitions of fixed and 
wireless broadband with the OECD and the EU. The revised indicators were included in the 
ITU data collection in 2010. The mandate of the EGTI was extended at the 8th WTIM in 2010 
and the group will continue to discuss and define new indicators, such as quality of service 
and mobile broadband tariffs. A revised version of the ITU Dejinitions will be published by 
ITU in 2011 in the Handbook for the Collection of Administrative Data on Telecommunication/ICT 
(ITU, 2011). 

ITU's definition of public telecommunication infrastructure originally excluded 
broadcasting. Given the interest in platforms other than circuit switched 
telecommunication networks, which can now provide "like-services", the ITU later 
appended definitions for broadcasting (e.g. multi-channel television connections, homes 
passed by cable, direct-to-home satellite antennas and so forth). 

At the time that ITU started its data collection, the public telecommunication sector 
excluded private networks that either did not automatically connect to the public network 
or that had limitations on membership. Prior to widespread liberalisation, networks such 
as the Internet that operated in parallel with or overlaid telecommunication 
infrastructures, were not considered part of the public telecommunication sector. They 
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were used by "closed user groups", such as academia, and were not accessible by the 
public. When the Internet was commercialised and became a mainstream part of the 
public telecommunication market, the ITU started to collect data to capture this 
development. Today the Internet market is captured in the ITU's Definitions and annual data 
collection through several indicators, including fixed Internet subscriptions, fixed and 
wireless broadband subscriptions and international Internet bandwidth. 

The OECD's main publications in this area are the Communications Outlook, the 
In/ormation Technology Outlook and the Science Technology and Industry Scoreboard. OECD 
publications can be purchased or freely read on line. Reports in the area of Communication 
Policy can also be freely downloaded from the OECD website. 2 ITU publishes its data in a 
number of formats, including in electronic format, and particularly through its World 
Telecommunication/ICT Indicators Database, and in various publications. Leading ITU 
publications in this area include the World Telecommunication/ICT Development Report, the 
Measuring the In/ormation Society Report, the Yearbook of Statistics, as well as a number of 
regional reports. 3 

Public switched telecommunication networks (PSTN) 

In most countries, ministries dealing with telecommunications or telecommunication 
regulatory authorities collect a basic set of indicators, which allows them to monitor 
market development, inform policy and ensure efficient regulation of the communications 
sector. For the most part, these indicators are tied to a service (e.g. telephony) provided over 
a specific infrastructure (e.g. PSTN). Increasingly, it has become evident that the diffusion 
of the Internet and the increased penetration of broadband services necessitate a more 
comprehensive list of indicators. 

ITU's Definitions defines a range of traffic measures for the PSTN. The measurements 
used across countries are generally one or more of: minutes, units of time. PSTN traffic may 
also be recorded in relation to whether it is local, domestic long distance or international. 
These categories are increasingly less applicable to the way that telecommunication prices 
are structured, in that tariffs are becoming less sensitive to distance and time. An 
improvement in traffic indicators has been to include and distinguish fixed and mobile 
originating calls, including those that are on- and off-net Internet calls. This has been 
particularly important in view of the accelerating usage of mobile telephony, especially in 
developing economies. 

The Internet 

A note on infrastructure technologies 

Most analysts expect a transition from circuit switched networks to IP networks 
(i.e. those that use the Internet Protocol). Sometimes these are referred to as "next 
generation networks". These networks are expected to - and increasingly can - provide any 
service that might once have needed a specialised or dedicated infrastructure. 
Telecommunication carriers, for example, which once specialised in telephony, are 
beginning to provide television services over DSL connections. At the same time, an 
increasing number of cable television networks are providing Internet telephony. In fact, 
any platform that can provide broadband access to the Internet enables the user, with the 
appropriate terminal equipment and software, to access Internet telephony services. As a 
result of these developments, services are no longer tied to specific platforms. A household 
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without a fixed telephone line may still have a telephony service provided by a different 
platform. 

The Internet, of course, uses some elements of the infrastructures created for PSTNs 
e.g. dial-up services use local loops. In that sense, the Internet and other private networks 
that overlaid public networks were recorded during historical data collection. 

Notwithstanding this, a range of new access technologies has emerged that use 
upgraded elements of infrastructures built for circuit switched and alternative networks. In 
the case of telecommunication networks, the primary development has been the 
deployment of digital subscriber lines (DSL). Cable modem access is enabled by networks 
that have been upgraded from their original purpose of providing cable television. A range 
of terrestrial fixed wireless and mobile cellular platforms can also provide broadband 
access. In respect of cellular service, UMTS (Universal Mobile Telecommunications System) 
represented an evolution in terms of services and data speeds from "second generation" 
mobile networks to "third generation" (3G) mobile technologies. A fourth generation of 
mobile wireless technologies is currently being deployed and is sometimes designated as 
4G if it represents a substantial increase in the capabilities of 3G (OECD, 2010). At the same 
time, a range of fixed wireless access platforms can provide broadband access within a 
local area (e.g. WiFi) or over a wider area (e.g. Wimax and Mesh Wireless Networks). 

A distinction between cellular and fixed wireless is that some fixed systems require an 
antenna fixed on a building to receive service. Cellular networks provide a greater ability 
for users to roam between cells than do fixed wireless networks (though fixed wireless 
networks can provide mobility within their coverage areas). Two-way broadband access via 
satellite requires a user to have a receiver capable of downstream and upstream 
communication. One-way satellite broadband accesses, and broadband access provided 
via digital television, require an alternative uplink technology (generally via an analogue or 
ISDN telephone line). Broadband access via power lines is another emerging platform. 
Finally, combinations of these networks can be used to provide broadband access. For 
example a satellite or power line might be used to provide a connection to a location, with 
local access provided with WiFi. In terms of definition, this group of access technologies is 
generally referred to as broadband (or high speed Internet access). A major emerging issue 
is that of capturing voice traffic over IP (VoIP) based platforms. The accelerating pace of 
VoIP has posed challenges for traffic measurement. 

Broadband measurement 

There is no standard definition of the threshold speed for broadband. 
Recommendation 1.113 of the ITU Standardization Sector (ITU-T) defines broadband as a 
transmission capacity that is faster than primary rate ISDN, at 1.5 or 2.0 Mbps (ITU, 2004). 
In the United States, the Federal Communications Commission (FCC) established one of 
the first thresholds for reporting on the deployment of advanced telecommunications. The 
FCC originally set the speed for broadband access at 200 kbps in one or both directions. In 
2010, the FCC redefined the minimum requirements of broadband, for the purposes of data 
collection, to 4 Mbps downstream and 1 Mbps upstream. 

When the OECD first began to collect data on the take-up of DSL and cable modem 
access, there was no DSL or cable modem service advertised at less than 256 kbps for 
downstream connectivity. As this threshold was higher than basic ISDN (i.e. 128 kbps) it 
seemed a convenient benchmark by which to exclude ISDN, which was counted elsewhere, 
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and record the new services that had become widely known under the collective term of 
broadband access. For the purpose of statistical collections, ITU's fixed broadband 
indicator is called "Total fixed (wired) broadband Internet subscriptions" and refers to 
subscriptions to high-speed access to the public Internet (a TCP/IP connection), at 
downstream speeds equal to, or greater than 256 kbps. 

In June 2002, the European Commission's Communications Committee (COCOM) 
established a working definition for the collection of broadband data in the European 
Union area. The threshold speed for both incumbent telecommunication carriers and new 
entrants was set by COCOM at 144 kbps. The objective was also to exclude basic ISDN lines 
(that is, 128 kbps). 

The issue of setting a baseline speed for broadband, in so far as measurement for 
OECD countries is concerned, is a transient one. In 2003, Telecom New Zealand and France 
Telecom's baseline speeds were both 128 kbps. At the close of 2004 they were increased to 
256 kbps and 512 kbps respectively. In 2003, the highest speed offered by France Telecom to 
residential users was 1 Mbps. At the close of 2004 an 18 Mbps service was introduced for a 
similar price. In the United Kingdom, the cable operator NTL raised its baseline speed from 
128 kbps to 10 Mbps between 2003 and 2005. 

Policy makers have an interest in the take-up of various broadband speeds because 
some services can be better utilised at higher speeds. However, once a DSL, cable modem 
or other broadband connection is in place it can be upgraded to a higher speed. 
Accordingly, it seems unproductive to exclude a connection at one speed that might be 
increased as competition in the market increases. An alternative for the near future would 
be to set a speed over which services that require high speed can perform at a reasonable 
level. 

Since 2010, OECD and ITU broadband statistics are categorised as Fixed (wired) 
broadband subscriptions and Wireless broadband subscriptions. Fixed (wired) broadband 
subscriptions include: DSL, Cable mobem, Fibre to the home/building subscriptions and 
other fixed (wired) broadband subscriptions such as power lines. Wireless broadband 
subscriptions include: Satellite subscriptions, Terrestrial fixed wireless subscriptions, 
Terrestrial mobile wireless subscriptions (the sum of active mobile broadband and 
dedicated mobile data subscriptions). The ITU Expert Group (EGTI) decided to introduce a 
new indicator "Fixed (wired) broadband by speed" which distinguishes broadband 
connections according to five different ranges of speed (ITU, 2010). ITU started to collect 
broadband speed indicators in 2010. 

Internet network statistics 

The Internet, by its very nature, enables data to be collected about itself through online 
surveys of computers and servers connected to it and interactive exchanges between 
applications. Examples include surveys of Internet hosts, secure servers and permanent 
connections. 4 Programs such as anti-virus software and firewalls can also remit 
information to a central point where these data are aggregated to provide information on 
security of networks. 5 

An increasing area of information in the realm of Internet statistics lies in the 
collection of domain names registered. These in turn provide an insight into the growing 
ubiquity and diffusion in Internet usage both in the developing and developed world. 
These categories primarily relate to the use of identifiers such as domain names, 
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Autonomous System Numbers (ASNs) and IP addresses. ICANN and most organisations 
with responsibility for country code domain names make statistics available on 
registration. 6 Regional Internet Registries that include RIPE (Europe), ARIN (North America), 
LACNIC (Latin America and Caribbean), APNIC (Asia-Pacific) and AFRINIC (Africa) also 
generate statistics on their activities. 7 The Internet Society also maintains a site with links 
to various sites containing information related to the Internet. 8 

Internet traffic exchange measures 

In most countries there are no data recording the "national total" for traffic carried by 
networks using the Internet protocol. Australia is one of the few countries where there are 
official data available on Internet traffic. These data are generated from the Australian 
Bureau of Statistics annual Internet Activity Survey (ABS, 2010). The survey collects data on 
the number of megabytes downloaded by users subscribing to ISPs in Australia. 

In other countries, data may be available for individual operators and a number of 

Internet Exchange Points (IXPs) publish statistics about traffic passing through their 

infrastructure. 9 Data are also sometimes available about which networks have direct traffic 

exchange relationships. These can either be seen in the peering tables at IXPs or via other 
10 

sources. 

The "Weekly Routing Table Report" is an automated weekly e-mail describing the state 
of the Internet Routing Table as seen from APNIC's router in Japan. 11 The report is posted 
weekly to several mailing lists dealing with technical aspects of the Internet. It includes a 
number of indicators for the global Internet, such as the number of autonomous systems 
in the routing table, and these data broken out by regional Internet registry (RIR) region. 
Autonomous Systems are networks with their own distinctive routing policies that appear 
in the Internet routing table. In September 2010, there were more than 35 566 Autonomous 
Systems (ASes) in the world - up from less than 3 000 at the close of 1997. 

In the United States, the Cooperative Association for Internet Data Analysis (CAIDA) is a 
collaborative undertaking among organisations in the commercial, government, and 
research sectors aimed at promoting greater co-operation in the engineering and 
maintenance of a robust, scalable global Internet infrastructure. 12 This includes the creation 
of Internet traffic metrics (in collaboration with the Internet Engineering Task Force/IP 
Performance Metrics group and other organisations) and work with industry, consumer, 
regulatory, and other representatives to assure their utility and acceptance. Another United 
States based institution is the Packet Clearing House (PCH). PCH is a non-profit research 
institute that supports operations and empirical analysis in the areas of Internet traffic 
exchange, routing economics, and global network development. 13 In 2007, PCH and OECD 
published "Good Practices in Internet Exchange Point Documentation and Measurement" 
(OECD, 2007). The paper sets out a methodology, produced within the Internet community, to 
improve measurement and documentation at Internet exchange points. 

Quality of services 

In 1990, the OECD defined a list of indicators for monitoring quality of service in 
respect of the PSTN (OECD, 1990). The ITU includes three quality of service indicators in its 
Definitions, all of which refer to the PSTN. Over time, some of these indicators have become 
less relevant for many OECD countries. In most OECD countries, for example, there is no 
waiting list for a fixed telephone line and service can be provided on demand. Since the 
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original indicators were defined, new services have been introduced (e.g. broadband 
Internet access) or have increased in importance (e.g. mobile telephony). 
Telecommunications regulators in some countries monitor these services but there has not 
been any international harmonisation of methodologies and definitions. Some regulatory 
authorities have begun to measure the quality of broadband connections and made tools 
available for users to both assess their own connection and provide aggregated data. The 
ITU EGTI will continue to discuss new indicators, including quality of service indicators 
specific to broadband and mobile services. 

Infrastructure investment 

The OECD and ITU both collect data on investment in public telecommunication 
networks and use the ITU Definitions. The key word in this definition is "public", which 
refers to offering services to the public rather than ownership of the network. This 
indicator does not record expenditure by business on telecommunications equipment or 
facilities that are not used to provide services to the public. It is aimed at collecting the 
capital expenditures of network operators offering services to the public (e.g. telephony and 
Internet access). 

Tariffs 

The OECD has developed a methodology for comparing tariffs for telecommunication 
services in respect of fixed line telephony (residential and small business), cellular mobile 
services (low, medium and high user), international fixed line telephony tariffs and leased 
lines. (OECD, 2000) In all these cases, a basket of services is included. For example, the 
residential fixed line basket includes a standard line rental and 1 200 calls per annum 
spread over different distances and times of the day/week. Variations include adding the 
costs of calls to mobile networks and international calls to the basket. ITU collects tariff 
information on telecommunication services through its annual tariff questionnaire, which 
is addressed to countries (usually the regulatory authority or the Ministry in charge of 
telecommunications/ICT). Reported tariff data, particularly in respect of mobile and 
Internet services, are complemented by research. In order to facilitate international 
comparison, data for fixed telephone, mobile cellular and broadband Internet tariffs are 
used to calculate standard fixed, mobile and broadband Internet baskets. Tariffs are shown 
in US$, in current international dollars (USD PPP) using Purchasing Power Parity (PPP) 
conversion factors, and as a percentage of monthly GNI per capita. These are also used to 
calculate the ITU ICT Price Basket, which is a composite basket that includes all three tariff 
sub-baskets (fixed telephone, mobile cellular and fixed broadband Internet) (ITU, 2009). 
The value for the ICT Price Basket is obtained by the simple average of the price of each 
sub-basket (in USD) expressed as a percentage of a country's monthly GNI per capita - 
capped at 100 per cent. The ICT Price Basket, first launched in 2008, is published annually. 
It includes a minimum of 150 countries. 14 



Notes 

1. Historically, the term "public telecommunication sector" referred to telecommunication 
infrastructure over which services were provided for the public at large. Traditionally, this included 
telecommunication networks (e.g. telephone, telex, telegraph, data) which consisted of exchanges 
(switches) linked by transmission circuits that connect subscribers to each other and with 
subscribers abroad. The term "public" referred to the access arrangement (anyone could subscribe 
to the network) rather than the ownership of the network. 
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2. They are available at: www.oecd.org/sti/telecom. 

3. Information on ITU publications can be found at: www.itu.int/iTU-D/ict/publications/. 

4. The longest running survey of Internet hosts, sponsored by ISC, can be found at: https:// 
www.isc.org/solutions/survey. Netcraft conducts surveys of secure servers and leased line 
connections to the Internet. Their website is at: http://news.netcraft.com/. 

5. See, for example, DShield which provides a platform for users of firewalls to share intrusion 
information at: www. dshield.org/, or McAfee's Virus map at: http://us.mca/ee. com/virusln/o/ 
default. asp. 

6. Registry reports to ICANN for generic top level domains are at: www.icann.org/tlds/monthly-reports/. 

7. ARIN's statistics are available at: www.arin.net/statistics/. APNIC statistics can be found at: 
www.apnic.net/stats/. LACNIC statistics are at: http://lacnic.net/en/est.html. 

8. www.isoc.org/internet/stats/. 

9. See, for example, the Amsterdam Internet Exchange at www.ams-ix.net/technical/stats/. 

10. The Swiss Internet exchange matrix is at: www.swissix.net/peermatrix.php. A traceroute between 
any two ISPs will generally show if they have a direct traffic exchange relationship or exchange 
traffic via additional networks. 

11. For example, the report is posted to the North American Network Operators Group (NANOG) 
Mailing list, the archives of which are at: www.merit.edu/maiI.archnjes/nanog/. Refer also to the 
weekly CIDR report at www.cidr-report.org/. 

12. www.caida.org/. 

13. www.pch.net/. 

14. For more information on the ICT Price Basket, see: www.itu.int/ITU-D/ict/publications/idi/2010/ 
index.html. 
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Chapter 4 



ICT Supply 



This chapter deals with the supply side of ICT, namely the ICT sector, its impacts, 
other ICT-producing entities, and ICT patenting actiuity. 
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The first major achievement of the WPIIS 1 came in 1998, when OECD member 
countries agreed on a definition of the ICT sector as a combination of manufacturing and 
services industries whose products capture, transmit or display data and information 
electronically. The definition was based on the International Standard Industrial 
Classification of All Economic Activities, Revision 3 (ISIC Rev. 3) and was considered to be a 
first step in obtaining initial measurement of the ICT sector. The definition was revised 
slightly in 2002, reflecting the release of ISIC Rev. 3.1 (UNSD, 2002). 

Recognising the importance of continually reviewing statistical standards, delegates 
agreed at the outset that periodic reviews of definitions would allow WPIIS to "re-assess 
the conceptual foundation of its standards, take account of the lessons learned with their 
implementation and make good use of improvements in the underlying classification 
systems" (OECD, 2006a). A good opportunity to review the ICT sector definition was 
presented in 2006, with the completion of revisions to ISIC Rev. 4 (UNSD, 2008). The OECD 
was an active participant in the ISIC revision process and the classification includes 
improvements to ICT-related categories. In 2007, a revised definition of the ICT sector 
based on ISIC Rev. 4 was agreed by OECD member countries (OECD, 2006a). 

Revisions made to the first part of this chapter in 2009 mainly reflect changes to the 
ICT sector definition (per OECD, 2006b). 

The ICT sector definition 

ICT production takes place in many industries, either as a principal or secondary 
output. It is therefore not possible to use industry statistics to get a complete measure of 
ICT production. Nevertheless, the identification of industries whose principal production 
is ICT goods or services was thought to be an essential component of an information 
society statistical framework. It allows for international comparison of the relative 
importance of these industries and analysis of differences in the industrial structures of 
countries. 

The list of ICT sector activities (industries) was originally decided on the basis of the 
following set of principles. 

• For manufacturing industries, the products of a candidate industry: must be intended to 
fulfil the function of information processing and communication including transmission 
and display or must use electronic processing to detect, measure and/or record physical 
phenomena or to control a physical process. 

• For services industries, the products of a candidate industry: must be intended to 
enable the function of information processing and communication by electronic 
means. 
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Changes to the principles were discussed during 2006 and finally agreed in 2007. The 
main difference was the removal of the second element for manufacturing industries, 
leading to a narrower definition of the ICT sector, as follows: 

"The production (goods and services) of a candidate industry must primarily be intended 
to fulfil or enable the function of information processing and communication by 
electronic means, including transmission and display." 

When the first ICT sector definition was developed in 1988, it was recognised that the 
preferred procedure would have been to first define ICT goods and services, and then to 
formulate the ISIC classes that had activities (manufacturing, wholesaling, etc.) involving 
those goods and services. However, in order to obtain an initial set of indicators for the ICT 
sector in a limited amount of time, the approach taken was to first define the activities, and 
subsequently work on a list of ICT goods and services that could complement and help to 
refine the activity-based definition. 

At its 2002 meeting, the WPIIS reviewed the definition. The group decided that the 
definition should not be changed, except to take into account the split of ISIC 5150 
Wholesale of machinery, equipment and supplies that was introduced in the 2002 ISIC revision 
(Rev. 3.1). The change made to the ICT sector definition was to replace ISIC 5150 with the 
two new classes 5151 Wholesale of computers, computer peripheral equipment and software and 
5152 Wholesale of electronic and telecommunications parts and equipment. 

The United Nations Statistics Division started revising the ISIC in 2001. The WPIIS 
Secretariat examined the May 2004 draft of ISIC Rev. 4 and, in late 2004, in consultation 
with interested member countries, put a submission to the United Nations Technical 
Subgroup (of the Expert Group on International Economic and Social Classifications) on 
classes with ICT activities. The OECD submission was generally supportive of the proposed 
changes affecting the ICT sector, supported proposals previously made (by OECD or others) 
and proposed some splits, where feasible, to other classes. The OECD submission was 
generally accepted by the Technical Subgroup. 

With the changes to ISIC nearly final, WPIIS started work in 2006 on reviewing the 
definition. The work was finalised and released in 2007, with the result being an ICT 
definition that looks significantly different from the original 1998 definition. Agreed 
changes included: 

• changes to the principles as outlined above, resulting in the omission of Class 2651 - 
Manufacture of measuring, testing, navigating and control equipment; 

• changes resulting from changes to ISIC Rev. 4, for instance, more ICT-specific classes, 
especially in Manufacturing; and 

• the removal of Manufacture of fibre optic cable from the definition. 

The United Nations Statistics Division has explicitly recognised the OECD ICT sector 
definitions as alternative structures of information and communication technology 
industries. 2 

Annex 7.A1 provides more information on WPIIS work on the ICT sector including 
deliberations leading to its agreement, the original (1998), revised (2002) and current 
(2006-07) definitions of the sector, and some practical notes on data collection. 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



59 



Production of ICT goods and services outside the ICT sector 

While the WPIIS has focused on the production activity of businesses that comprise 
the ICT sector, it is acknowledged that they are not the only entities in the economy to 
produce ICT goods and services. The latter may be produced by other sectors, for instance 
general government, and by businesses outside the ICT sector. Their output may be ICT 
products produced for sale or for own use. 

Additionally, ICT products that primarily originate from the ICT sector may be 
produced by organisations in other industries for sale or own use. In particular, "own 
account" software, that is software development work done by entities for their own use, 
may be significant for some businesses outside the ICT sector and for general government 
organisations. Attempts are underway in a number of countries to measure the investment 
in "own account" software. More information on this subject can be found in Chapter 5. 

The impacts of the ICT sector 

The ICT sector may have considerable impacts on economic performance, as it is 
characterised by very high rates of technological progress, output and productivity growth. 
These characteristics imply a considerable contribution of the sector to economy-wide 
performance. 

The impacts of the sector can be examined in several ways - directly, through its 
contribution to output, employment or productivity growth, or indirectly, for example as a 
source of technological change affecting other parts of the economy. 

Empirical work 

OECD work has primarily focused on the direct impacts of the ICT sector. For example, 
in most OECD countries, the contribution of ICT manufacturing to overall labour 
productivity growth rose over the 1990s (Pilat and Wolfl, 2004). OECD estimates show that 
ICT manufacturing made the largest contributions in Finland, Hungary, Ireland and Korea, 
where close to 1 percentage point of aggregate labour productivity growth in the 1995-2001 
period was due to ICT manufacturing. The ICT-producing services sector 
(Telecommunications and Computer services industries) plays a smaller role in aggregate 
productivity growth, but has also been characterised by rapid progress (OECD, 2003b). Some 
of the growth in ICT-producing services is also due to the emergence of the computer 
services industry, which has accompanied the diffusion of ICT in OECD countries. The 
development of these services has been important in implementing ICT, as the firms in 
these sectors offer key advisory and training services and also help develop appropriate 
software to be used in combination with ICT hardware. 

Measurement issues 

A number of problems affect the measurement of the economic impacts of the ICT 
sector. First, the official OECD definition of the ICT sector cannot be easily applied to the 
analysis of output and productivity growth. Analysis of productivity growth requires time 
series of value added and/or production in constant prices, which implies price deflators 
for the appropriate industries. These are typically not available for detailed categories and 
OECD work has therefore primarily focused on the main categories that can be 
distinguished in the national accounts by activity, i.e. ISIC 30-33 (Electrical and Optical 
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Equipment), ISIC 64 (Post and Telecommunications) and ISIC 72 (Computer and Related 
Activities). 3 

Second, the available deflators are not always comparable across countries. Several 
countries use hedonic methods to deflate output for the computer industry (e.g. Canada, 
Denmark, France, Sweden and the United States), whereas other countries use standard 
deflators. Adjusting for these methodological differences in computer deflators for the 
purpose of a cross-country comparison is difficult since there are considerable cross- 
country differences in industrial specialisation. For example, only few OECD countries 
produce computers, where price falls have been very rapid; many only produce peripheral 
equipment, such as computer terminals. The differences in the composition of output are 
typically larger than in computer investment, where standardised approaches have been 
applied (e.g. Schreyer et al., 2003). 

Future developments 

There are several issues related to the economic impacts of the ICT sector that would 
benefit from further analysis. For example, questions can be raised regarding the link 
between having an ICT sector and benefiting from ICT investment and use. Some analysts 
have used the experience of a country such as Australia to suggest that having a large ICT 
manufacturing sector might not always be necessary. However, this hypothesis would 
benefit from more research as there could be spill-over effects associated with having an 
ICT manufacturing sector. Moreover, in order to benefit from ICT use, it might be important 
to have a well-developed domestic industry providing software and computer services to 
firms using the technology. This hypothesis would also benefit from further analysis. 

ICT patenting activity 
Introduction 

Patents are an intellectual property right issued by authorised bodies to inventors 
allowing them to make use of, and exploit, their inventions for a limited period of time 
(generally 20 years). Patents are granted to firms, individuals or other entities as long as the 
invention fulfils certain criteria: it must be novel, involve an inventive step (i.e. be non- 
obvious) and be capable of industrial application. The patent holder has the legal authority 
to exclude others from commercially exploiting the invention during the duration of the 
patent life. In return for the ownership rights, the applicant must disclose information 
relating to the invention for which protection is sought. The disclosure of the information 
is thus an important aspect of the patenting system. 

Statistical and policy use of patent indicators 

Patents are a key measure of innovation output. They can be used to measure R&D 
output, knowledge spillovers, inventive performance, as a tool to assess the direction of 
research, and the strategic aims of companies. Patents can also provide an insight into the 
level of internationalisation (of innovative activities), co-operation (of R&D activities) and 
mobility of researchers. Patents data are widely used as a proxy for innovation and 
Griliches (1990) refers to patents as "a good index of inventive activity". 

Since there are many advantages associated with patents as statistical indicators, they 
are frequently used, along with other science and technology (S&T) indicators, to measure 
technical change and inventive activity. It has become standard practice to include a 
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section on patents in national and international S&T publications. Statisticians and 
researchers are not the only users of patent documents, however. Business managers are 
increasingly utilising patent documents to monitor the latest technological developments 
and examine the strategies and directions of competitors. 

Strengths and limitations of using patent documents for statistical analysis 

Like most statistical indicators, patent indicators have strengths and limitations. The 
main strengths of patent indicators are: 

• A patent document is a rich source of information. It provides a detailed description of 
the invention; the technological areas to which the invention belongs (i.e. patent classes); 
the scope of the legal protection (i.e. claims); citations to previous patents and non- 
patent literature; information about the inventor and the right holder (e.g. name and 
address); and timeline of the invention (e.g. various dates recorded in a patent 
document); 

• Each year a large number of patents are filed with national and regional patent offices. 
For example, patent applications at the European Patent Office (EPO) and US Patent and 
Trademark Office (USPTO) account for around 110 000 and 330 000 per year (2000-2004), 
respectively. This makes patent documents the largest data source on innovation 
activity. In addition, unlike other data sources, patent data are available for a long time 
period (e.g. the first patent issued by the USPTO dates back to 1836); and 

• Patent documents are public and increasingly available over the Internet. This makes 
them a unique data source from which to gather statistical information at relatively low 
cost. 

However, there are some limitations to the use of patent data, especially for statistical 
analysis. The main weaknesses of patent indicators are: 

• Not all inventions are patentable. 

• In many instances, inventors prefer to use other means to protect the invention 
(e.g. secrecy). 

• The value distribution of patents is highly skewed, i.e. some patents are of considerable 
(technical and economic) value, but many have little or no value. However, various 
weighting procedures have been devised to overcome this limitation (e.g. citations, 
patent families, use of renewal data, etc.). 

• The propensity to patent differs across countries and industries. This makes it harder to 
compare and interpret indicators across countries and industries. However, it is possible 
to deal with this shortcoming by focusing on specific industries and/or by using dummy 
variables. 

• Patents are administrative documents and are not designed for statistical purposes. 
Therefore certain manipulations are necessary to make the information suitable for 
statistical use. For example, patent examiners assign patent classification codes to each 
patent document. The primary aim of this process is to facilitate prior-art searches 
(not for statistical needs). Therefore, certain manipulation of the classification information 
is needed to make the information suitable for statistical purposes (e.g. deriving patent 
indicators for specific technological areas). 

Despite all these limitations, patents are one of the best available data sources for 
measuring innovative activity, as highlighted by Griliches (1990): "... patents statistics 
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remain a unique resource for the analysis of the process of technical change. Nothing else 
even comes close in the quantity of the available data, accessibility, and the potential 
industrial, organisational, and technological detail." 

Designing indicators to measure innouative activity: selection of appropriate criteria 

Patent documents are a rich source of information. They include detailed information 
about the invention (scope of the invention, inventors, owners, etc.), as well as information 
about the administrative process of the patent office (e.g. date of application, the procedure 
used to file the application, search report, whether an application has been successful or 
not). The large amount of information can also be problematic, especially in identifying 
and extracting the relevant information from a complex patent document. For example, 
many dates are recorded in a patent document (e.g. priority date, application date, 
publication date, grant date). Similarly, for statistical purposes, a patent can be attributed 
to the country of the inventor, the country of the applicant and the country of the priority 
application. Which criteria should be used to develop patent indicators to measure 
innovative activity? 

The selection of appropriate criteria for calculating patent indicators is crucial in 
conveying the correct message. The decision on the selection of the criteria depends on 
user needs. For example, if the intention is to use patent indicators to measure ownership 
of patents, then the relevant geographical distribution criterion is the applicant's country 
of residence. However, if the intention is to measure inventive activity, then the inventor's 
country of residence is the most appropriate criterion. OECD's patent indicators are 
constructed to reflect innovative performance, therefore the appropriate criteria used to 
develop OECD patent indicators are: inventor's country of residence, priority date, and 
fractional counting (explained in Dernis et al., 2001 and OECD, 2006c). 

It should be noted that in many S&T publications, patent indicators are reported 
according to the grant date. This is partly due to lack of methodological guidelines and the 
misconception that grant date data are timely relative to the application (or priority) date. 
However, drawing conclusions about the innovative activity using grant date patent 
indicators can be extremely misleading because the total number of patents granted is not 
only a function of the inflow of patent applications, but is also dependent on the number 
of patent examiners, the budget of the patent office, and other external factors. 

Patent indicators by industry 

Unfortunately, patent documents do not include information about the industry to 
which the patent belongs. This hampers the ability of researchers to develop patent data 
by industry. Nevertheless, it is "primarily a technical problem" (Griliches, 1990) that can be 
solved by exploiting the available information from patent documents. For example, patent 
classification codes 4 that are assigned to each patent document by patent examiners are 
frequently used to develop industry-patent classification concordances. 

There have been a number of endeavours to develop concordance tables to translate 
patent classification codes into industry classification codes. Although several researchers 
have attempted to develop a reliable patent-industry classifications concordance table, so 
far this has proved to be difficult to achieve. Schmookler (1966) was one of the earliest 
researchers to construct patent data by industries. His approach consisted of reviewing 
carefully a set of subclasses, sampling a number of patents, and allocating the patents 
to relevant industries. A similar approach was taken by Scherer (1982) where around 
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15 000 patents granted by the USPTO were examined to determine the nature of the 
invention, the industry of origin of the invention, and the anticipated industry of use of the 
invention. Evenson and Putnam (1988) used data from the Canadian Intellectual Property 
Office (CIPO) 5 to construct a patent-industry concordance table, 6 widely referred to as the 
Yale Technology Concordance (YTC). The focus of this article is not to survey the literature 
therefore other concordance tables 7 based on similar methodologies are not covered here. 

The National Bureau of Economic Research (NBER) took a different approach for 
allocating patents by industries. They started "from patent totals for particular firms and 
then grouped them into industries according to the firm's primary activity" (Griliches, 
1990). However, the main weakness of this approach is that large companies are active in 
many fields, therefore assigning all the patents of a firm to the sector of its main economic 
activity may provide a blurred image of the patenting activity. 

Definition of ICT- related patents 

Rather than developing a concordance table between patent and industrial 
classifications, the OECD adopted a different approach for the definition of ICT-related 
patents. The strategy is to identify a list of International Patent Classification (IPC) codes 
that are assigned to ICT-related patents. 8 However, before attempting to identify the IPC 
codes associated with ICT-related patents, it is necessary to specify what is meant by the 
ICT sector. The definition of the manufacturing component of the ICT sector developed by 
the OECD in 1998 (see Chapter 4 for details) has been adopted here for defining ICT patents. 
OECD's definition of the ICT sector includes: telecommunications equipment; consumer 
electronics; computers and office machinery; instruments and appliances for measuring, 
checking and industrial process control; and electronic components. 9 

In the initial phase (2001), the definition of ICT-related patents (i.e. the identification of 
a list of IPC codes associated with ICT patents) was developed on the basis of the following 
strategies: keyword search, analysis of IPC classes of well-known ICT-related patents and 
analysis of a sample of patents of companies that are active in the ICT field. 10 The 
following IPC classes were proposed to be included in the provisional definition of ICT- 
related patents: G06 (Computing; Calculating; Counting); Gil (Information Storage); and 
H04 (Electric Communication Technique). 11 This definition was considered to be 
provisional and further work was expected to be conducted in order to refine the 
definition. Nevertheless, based on the provisional definition, ICT-related patent indicators 
were reported in OECD publications (e.g. OECD, 2001). 

In 2003, a consultant, 12 with an extensive knowledge of patent classification systems, 
was engaged by the OECD to undertake further work to refine the definition of ICT-related 
patents. The aim was to develop a definition at a more detailed level of IPC codes than the 
earlier definition (which is at a highly aggregated level). The search strategy adopted for 
identifying ICT-related patents was based on the consultant's identification of the relevant 
IPC codes rather than the keyword searches that are based on official public documents. 13 
For identifying the appropriate IPC codes for ICT-related patents, the consultant scanned 
the whole IPC classification using a top-down approach. The search started at the section 
level, followed by sub-sections, classes, sub-classes, groups, and finally sub-groups. This 
resulted in the identification of the appropriate IPC codes that should be included in the 
definition of ICT-related patents. 

Table 4.1 below provides the details of the IPC codes included in the OECD's current 
definition of ICT-related patents. 14 This definition is more detailed than the earlier one, 
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Table 4.1. Definition of ICT- related patents, based on IPC codes 



IPC code 


Details 2 


Telecommunications 


G01S 


Radio navigation 


G08C 


Transmission systems for measured values 


G09C 


Ciphering apparatus 


H01P, H01Q 


Waveguides, resonators, aerials 


H01 S003-025, H01 S003-043, H01 S003-06, H01 S003-085, Semiconductor lasers 


H01S003-0915, H01S003-0941, H01S003-103, 




H01S003-133, H01S003-1S, H01S003-19, H01S0C3-25, 


H01S005 




H03B-D 


Generation of oscillations, modulation, demodulation 


H03H 


Impedance networks, resonators 


H03M 


Coding, decoding 


H04B 


Transmission 


H04J 


Multiplex communication 


H04K 


Secret communication 


H04L 


Transmission of digital information 


H04M 


Telephonic communication 


H04Q 


Selecting, public switching 


Consumer electronics 


G11B 


Information storage with relative movement between record carrier and transducer 


H03R H03G 


Amplifiers, control of amplification 


H03J 


Tuning resonant circuits 


H04H 


Broadcast communication 


H04N 


Pictorial communication, television 


H04R 


Electromechanical transducers 


H04S 


Stereophonic systems 


Computers, office machinery 


B07C 


Postal sorting 


B41J 


Typewriters 


B41K 


Stamping apparatus 


G02F 


Control of light parameters 


G03G 


Electrography 


G05F 


Electric regulation 


G06 


Computing 


G07 


Checking devices 


G09G 


Control of variable information devices 


G10L 


Speech analysis and synthesis 


G11C 


Static stores 


H03K, H03L 


Pulse technique, control of electronic oscillations or pulses 


Other ICT 


G01B, G01C, G01D, G01F, G01G, G01H, G01J, G01K 


, G01L, Measuring, testing 


G01M, G01N, G01P, G01R, G01V, G01W 




G02B006 


Light guides 


G05B 


Control and regulating systems 


G08G 


Traffic control systems 


G09B 


Educational or demonstration appliances 


H01B011 


Communication cables 


H01J011, H01J013, H01J015, H01J017, H01J019, 


Electric discharge tubes 


H01J021, H01J023, H01J025, H01J027, H01J029, 




H01J031, H01J033, H01J040, H01J041, H01J043, 




H01J045 




H01L 


Semiconductor devices 


1. This definition was developed, on behalf of the OECD, by Ulrich Schmoch, Fraunhofer Institute for Systems and 
Innovation Research (Schmoch, 2003). Only three sub-classes were affected by the changes in IPC (8th edition): 
H01S003-06 replaces H01S003-063 and H01S003-067; H01S003-0915. 

2. For full details of the IPC codes, see: tuu;u).u;ipo.int/classifications/ipc/en/. 
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developed in 2001, and like the OECD's definition of the ICT sector, it covers a wider range 
of ICT domains. ICT patent indicators, based on this definition, have appeared in several 
OECD publications (for instance, OECD, 2003a, 2005 and 2006c). 

Future developments 

Since mid-2003, the OECD has been disseminating ICT patent statistics that are 
calculated according to the definition shown in Table 4.1. and it intends to use this 
definition for the near future. A new IPC classification system (IPC 8th edition) entered into 
force on 1 January 2006. The new edition of the IPC will be subject to continuous revisions 
at the advanced level and these will be directly applied to patent documents 
retrospectively. Therefore, the accuracy of the present definition of ICT patents needs to be 
checked on a regular basis. 

Future reviews will also take into account the revisions to the OECD definition of the 
ICT sector finalised in 2006 (see this chapter) as well as revisions to the OECD classification 
of ICT products finalised in 2007 (see Chapter 2). 

Notes 

1. Then the Ad Hoc Meeting on Indicators for the Information Society under the aegis of the ICCP 
Statistical Panel. 

2. For example, http://unstats.un.org/unsd/cr/registry/docs/i31_ict.pd/. 

3. These are references to the 2002 definition of the ICT sector. 

4. The most widely used patent classification system is the International Patent Classification (IPC), 
which is a hierarchical system that divides technology into eight sections with almost 70 000 fields 
or groups. However, other patent classifications are also in use at the national and regional level. 
For example, EPO patent documents are classified according to ECLA codes (the patent 
classification system of the EPO). Similarly, USPTO patent documents are classified according to 
USPC codes (the patent classification system of the USPTO). 

5. The Canadian Intellectual Property Office (CIPO) simultaneously assigned codes for the technology 
field (IPC codes), the industry of manufacture (IOM) and the sector of use (IOU) to each granted 
patent (around 30 000 patents) during 1975-95. 

6. This was based on the tabulated information on all 30 000 patents to determine the probability 
that a patent with a specific IPC code has a particular IOM-SOU combination. 

7. Notable examples are: Verspagen et al. (1994); Johnson (2002); Schmoch et al. (2003), and USPTO 
USPC-SIC concordance table (see Hirabayashi, 2003). 

8. The advantage of using the IPC classification system is that it is used by a large number of patent 
offices, which makes it possible to derive internationally comparable ICT-related patent statistics 
for a large number of countries and/or patent offices. 

9. The OECD definition of the ICT sector was revised in 2006 (reflecting the revision to ISIC Rev. 4) and 
no longer includes manufacturing of instruments and appliances for measuring, checking and 
industrial process control. 

10. This work was conducted by a patent examiner from the Japanese Patent Office (JPO) who was on 
secondment to the OECD. 

11. For full details of IPC codes, see: u;u;u;.u;ipo.int/dassifications/ipc/en/. 

12. Dr. Ulrich Schmoch from Fraunhofer Institute Systems and Innovation Research, Karlsruhe, 
Germany (Schmoch, 2003). 

13. The keyword search strategy is not preferred here because the legal requirements of disclosure 
with regard to titles and abstracts are not very strict. In certain circumstances, keyword searches 
might be preferable because the patent classification does not cover new technology areas 
(classification systems tend to lag behind the development of technology areas). If a keyword 
search is necessary, then it should be conducted on databases with good facilities for such 
searches. 
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14. Note that in some cases there was no clear cut association between IPC codes and ICT industries. 
In particular for the following cases: H03B, H03C, H03D, H03H, H03M, H04L, G11B, H03F, H03G, H03J, 
H04H, H04N, H03K, H03L; the decision to assign the IPC codes to a particular sector (e.g. H03B to 
telecommunications rather than consumer electronics) was taken according to the main focus of 
the code. 
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ICT Demand by Businesses 



This chapter describes the OECD model suruey of ICT use by businesses and 
discusses the statistical standards for e-business and e-commerce. It also looks at 
the topics of ICT inuestment and expenditure by business, and the economic impacts 
of ICT inuestment and use. 



5. ICT DEMAND BY BUSINESSES 



Introduction 

One of the more important areas of WPIIS work is the development of statistical 
standards for measuring ICT use and e-commerce by businesses. Statistics on the diffusion 
of new information technologies among businesses are important for evaluating the extent 
to which the use of information technology has an impact on overall economic 
performance. Greater use of ICT in the production process may, for example, help raise the 
overall efficiency of the use of capital and labour, for instance, by reducing inventories and 
transaction costs. 

This chapter considers the OECD model survey of ICT use by businesses, development 
of statistical standards for e-commerce and the challenges of doing the same for e-business. 
In addition, it includes articles on measurement of ICT investment and expenditure, and 
the economic impacts of ICT investment and use. 

This chapter was revised in 2010. Revisions made in 2010 mainly reflect changes to 
definition of e-commerce. 

OECD model survey of ICT use by businesses 1 

The WPIIS started working in 1999 with the Voorburg Group and individual member 
countries to develop a model survey on the use of ICT goods and services by businesses. 
The underlying idea was to guide the collection of internationally comparable statistics of 
ICT use and e-commerce in businesses across OECD member countries. After two years 
experience of sharing and testing some of the questions by several OECD member 
countries, a final proposal for a model questionnaire on ICT use in enterprises was 
discussed and adopted by the WPIIS at its meeting in 2001 (OECD, 2001). 

The model survey was revised in 2005 to improve harmonisation with member 
country ICT use surveys and to reorient the surveys towards current areas of high policy 
relevance. More information on the development of the model, as well as the model itself, 
can be found in Annex 5.A1. Of note, the 2005 OECD model survey of ICT use by businesses 
does not take into account the 2010 revision of the OECD statistical definition of e-commerce. 
At its 2010 meeting, WPIIS agreed to update the model survey of ICT use by businesses for 
the 2011 meeting. 

The revised model survey is intended to provide guidance for the collection of 
statistics on business use of ICT, including IT security, e-business and e-commerce. It has 
been designed as an economy-wide survey vehicle but can also be used in surveys covering 
specific sectors. Countries are encouraged to use the model as a core part of their survey 
development in order to improve the international comparability of information collected 
and compiled on this topic. 
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Measurement of e-commerce is discussed below. Discussion of other topics included 
in the revised model questionnaire can be found in this Guide as follows: 

• Trust in the online environment (including IT security) - the statistical challenges are 
discussed in Annex 5.A1. 

• E-business - in this chapter. 

• Digitised products - in Chapter 7 and Annex 5.A1. 

• E-government - the statistical challenges are discussed in Annex 5.A1. 
E-commerce 

Because of the high policy interest in e-commerce and the mandate received by OECD 
Ministers in Ottawa in 1998 to "compile definitions of e-commerce that are policy relevant 
and statistically feasible", the WPIIS has devoted a great deal of attention to the 
measurement of e-commerce. In particular, the WPIIS worked on the development of a 
framework for user needs and priorities, definitions, and statistical measurement of core 
e-commerce indicators. 

The 2001 model survey paper suggested that more work be done on income concepts 
relating to electronic transactions. Since then, a number of conceptual issues relating to 
e-commerce and electronic finance have been discussed but not necessarily resolved. This 
section outlines those issues and recommends a solution to many of them. The model 
questionnaire in Annex 5.A1 incorporates definitions and instructions consistent with 
those recommendations. 

In 2001, OECD member countries endorsed two definitions of electronic transactions 
based on narrower and broader definitions of the communications infrastructure. 
According to the OECD definitions, it is the method by which the order is placed or 
received, not the payment or channel of delivery, which determines whether the 
transaction is an e-commerce transaction. The narrow definition of e-commerce 
transactions refers to those conducted over the Internet, while the broad definition refers 
to all computer-mediated networks. The 2001 OECD definitions of e-commerce are shown 
in Table 5.1 below. In 2009, the definition of e-commerce was revised. 

In April 2009, OECD member countries endorsed their latest definition of e-commerce. 
The OECD revised the guidelines for interpreting the definition of e-commerce and 
encouraged countries to take such guidelines into account when developing their 
questionnaires. Table 5.2 below shows the current OECD definition of e-commerce 
transactions and operational guidelines. 

At its 2008 meeting, WPIIS agreed to revise the e-commerce definition for the 2009 
meeting. 

The revised e-commerce definition was approved by WPIIS in April 2009, and 
declassified by the Committee for Information, Computer and Communications Policy 
(ICCP) in October 2009. 

The 2009 definition of e-commerce unifies the broad and narrow definitions into a 
single one. 2 The definition and guideline is shown in Table 5.2 below. 
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Table 5.1. The 2001 OECD definitions of e-commerce transactions 
and interpretation guidelines 



E-commerce transactions OECD definitions 



Guidelines for the interpretation of the definitions 
(WPIIS proposal April 2001) 



BROAD definition An electronic transaction is the sale or purchase of 

goods or services, whether between businesses, 
households, individuals, governments, and other 
public or private organisations, conducted over 
computer-mediated networks. The goods and 
services are ordered over those networks, but the 
payment and the ultimate delivery of the good or 
service may be conducted on or off-line. 

NARROW definition An Internet transaction is the sale or purchase of 

goods or services, whether between businesses, 
households, individuals, governments, and other 
public or private organisations, conducted over the 
Internet. The goods and services are ordered over the 
Internet, but the payment and the ultimate delivery of 
the good or service may be conducted on or off-line. 



Include: Orders received or placed on any online application 
used in automated transactions such as Internet 
applications, EDI, Minitel or interactive telephone systems. 



Include: Orders received or placed on any Internet 
application used in automated transactions such as web 
pages, Extranets and other applications that run over the 
Internet, such as EDI over the Internet, Minitel over the 
Internet, or over any other web enabled application 
regardless of how the web is accessed (e.g. through a 
mobile or a TV set, etc.) 

Exclude: Orders received or placed by telephone, facsimile, 
or conventional e-mail. 



Table 5.2. The 2009 definition of e-commerce 



OECD definition of e-commerce 



An e-commerce transaction is the sale or purchase of goods or 
services, conducted over computer networks by methods specifically 
designed for the purpose of receiving or placing of orders. The goods or 
services are ordered by those methods, but the payment and the ultimate 
delivery of the goods or services do not have to be conducted online. An 
e-commerce transaction can be between enterprises, households, 
individuals, governments, and other public or private organisations. 



Guidelines for the Interpretation 



Include: orders made in web pages, extranet or EDI. The type is 

defined by the method of making the order. 

Exclude: orders made by telephone calls, facsimile, or manually typed 

e-mail. 



The rationale for a new definition can be summarised as follows: 

• It is difficult to produce good e-commerce estimates based on a network distinction 
because respondents find it difficult to make such a distinction; the convergence of 
technologies makes it increasingly more challenging. 

• Many users find it more relevant to understand how e-commerce is being done rather 
than over which networks it is being done. 

• The two-tiered definition of e-commerce has resulted in less international 
harmonisation. 

The new definition attempts to respect a few basic principles: 

• It should be coherent, simple and pragmatic; in that spirit, the definition does not 
attempt to cover all methods of doing electronic transactions, but rather concentrates on 
those that are known and definable and that are the most important at this point in 
time. 

• It should be limited to clearly defined concepts so as to avoid incoherent interpretation 
by respondents to the extent possible. 

• It should acknowledge that as technologies and policies evolve, new forms of e-commerce 
that are not defined and included here might become of interest and will need to be 
considered in the future. 



72 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



5. ICT DEMAND BY BUSINESSES 



It is hoped that the new definition and measurement framework will contribute to 
improving the quality and comparability of e-commerce estimates over time and among 
countries. 

In addition to moving from a two-definition system to a single-definition system, the 
2009 definition includes terminology changes intended to simplify and clarify the 
concepts. 

• The expression "electronic transaction" is replaced by "e-commerce transaction". 

• The expression "computer-mediated networks" is replaced by "computer networks" to 

avoid unnecessary complication of terminology. 

• The definition now includes the statement "by methods specifically designed for the 
purpose of receiving or placing orders". This is done in order to make it clear that not 
all activities over networks are targeted, only those specifically intended for selling. 
This implies the presence of an e-sales system. Excluded are orders by manually typed 
e-mail, telephone calls or facsimile. 

• The expression "ordered over those networks" is replaced by "ordered by those 
methods". 

• The expression "may be conducted on or offline" is replaced by "does not have to be 
conducted online". 

A number of changes also apply to the interpretation guidelines: 

• Reference is made to the web (or extranet) and EDI only. The Minitel and interactive 
telephone systems examples are no longer mentioned. 

• The type of e-commerce transaction is defined by the method of making the order. This 
approach should mitigate the interpretation problems where both types, EDI and web, 
are used in the process. An example is a situation where an order is made by the 
customer through a web-application but the information is transmitted to the seller as 
an EDI-message. However, in this case, the type of selling application is web-based - EDI 
is the business application to transmit information about the sale. 

• Exclusions that previously appeared in the narrow definition implementation guidelines 
have been integrated into the new definition, albeit using different wording. The 
exclusion for orders placed by telephone now reads "orders made by telephone calls" in 
order not to exclude web sales done by mobile phones using an Internet-browser. The 
exclusion for orders by conventional e-mail now reads "manually typed e-mail". 

• The guidelines refer to orders made only (not purchases), since ordering is the key 
element of the definition. 

The framework for measurement 

The framework for measurement is proposed as an implementation tool. It goes 
beyond the conceptual definition by specifying the types of e-commerce of interest, the 
so-called "functional split". 

The functional split is now generally regarded as the best approach to deal with the 
measurement of e-commerce. It was adopted as a general approach in the European Union 
in 2008 and is consequently used in many OECD countries. 
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Table 5.3. The framework for measurement 

Type Definition of the type of e-commerce 

Web e-commerce Orders made at an online store (webshop) or via web forms on the Internet or extranet regardless of how the web is 

accessed (computer, laptop, mobile phone, etc.) 

EDI e-commerce Orders initiated with EDI. 

EDI (electronic data interchange) is an e-business tool for exchanging different kinds of business messages. EDI is here 
used as a generic term for sending or receiving business information in an agreed format which allows its automatic 
processing [e.g. EDIFACT, XML, etc.) and without the individual message being manually typed. 
"EDI e-commerce" is limited to EDI messages placing an order. 



The proposed functional categories are "web e-commerce" and "EDI e-commerce". 
These are the main e-commerce activities at this time and are found to be clear concepts 
for enterprises. They are also well defined. 

The expert group acknowledged that additional types of e-commerce might become 
important to measure in the future. The proposed framework allows for the future 
identification of additional functional categories as the need arise while keeping existing 
ones intact. 

Other functional types 

The expert group recommended that countries planning to implement the functional 
split approach described above, consider the possibility of adding a residual category, 3 if it 
is seen as relevant in the national context. This would allow for the identification of 
emerging functions important enough to warrant separate measurement. It is recognised 
that open-ended residual categories require resources to code and classify responses in a 
coherent manner, but it is one of the best methods to develop surveys based on evidence. 

The 2001 e-commerce definition mentions interactive telephone systems, but they 
generally have not been included in the measurement of e-commerce. As mentioned 
earlier, the expert group recommended its exclusion in order to keep the definition simple 
and to concentrate on the most important, well defined and recognized activities. 

Mobile e-commerce (M-commerce) is included in the proposed definition to the extent 
that it is done via web pages, which probably is a growing phenomenon. Other kinds of 
m-commerce - e.g. SMS and mobile cash payment solutions are not included at present. 

There is clearly interest in the measurement of m-commerce, but no agreed definition 
and no obvious measurement method. The expert group was not convinced it is possible to 
integrate m-commerce within the existing e-commerce measurement system in a 
coherent manner, or that the inclusion of m-commerce within the e-commerce definition is 
the best solution to the measurement of m-commerce. If there is an interest, the 
development of specific concepts and tools would be necessary in order to properly measure 
the m-commerce phenomenon. Other business use of mobile tools beyond m-commerce 
would also deserve closer investigation. 

Future work 

The measurement of e-commerce has many methodological challenges that have not 
been discussed. The adoption of different methodologies by member countries to deal with 
the collection of data and the production of estimates can seriously affect the 
comparability of results. The treatment of outliers or of e-commerce by multinational 
enterprises, the imputation of e-commerce values and third party issues are but a few 
examples of methodological issues that have a material impact on estimates. 
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E-business 

Measurement of e-business is of particular interest to policy makers because of the 
potential productivity impacts of ICT use on business functions. 4 However, the ongoing 
challenges in this measurement field are significant and include problems associated with 
measuring a subject that is both complex and changing rapidly. These difficulties are 
exacerbated by limitations imposed by the statistical vehicles used to collect ICT use data 
(usually, economy-wide, mail-based survey vehicles for which simple "yes/no" questions 
work best). 

History of WPIIS work on measuring e-business 

In 1999, the WPIIS established an Expert Group on Defining and Measuring E-commerce to 
"compile definitions of e-commerce which are policy relevant and statistically feasible". 
By 2000, work of the Group had resulted in definitions for e-commerce transactions but not 
e-business processes. In 2001, the first model questionnaire on the use of ICT/E-commerce 
in the business sector was agreed by the WPIIS but it did not comprehensively cover the 
range of an enterprise's possible e-business processes. In 2002, it was agreed that a module 
on e-business processes be developed and the Expert Group on the Measurement of E-business 
Processes was established. 

At the 2003 WPIIS meeting, the expert group proposed a definition of e-business 
processes based on functionality rather than technology: (automated) business processes 
(both intra- and inter-firm) over computer mediated networks. In addition, the group 
proposed that e-businesses processes should integrate tasks and extend beyond a stand- 
alone or individual application. Nine broad business functions were identified and described in 
terms of e-business processes, e.g. customer acquisition and retention; e-commerce; finance, 
budget and account management; logistics (inbound and outbound); and inventory control. 

An expert meeting on measuring e-business was hosted by the OECD in December 
2003. The meeting involved delegates from national statistical offices, government policy 
organisations, the private sector (including computer services firms) and academia. The 
discussion was useful and wide-ranging but the outcome was not conclusive. The major 
issues raised and discussed were: 

• Definition of e-business. There were diverse views expressed and the question of 
whether a definition was necessary was raised. 

• Framework for describing and classifying e-business processes. Is a classification 
possible given the integrating and evolving nature of e-business processes? Is it 
necessary? 

• Which broad business functions are important and measurable? Are they generalisable 
across industries, firm size and countries? 

• Networks. What kind of networks (Internet Protocol or all computer-mediated networks) 
are we interested in measuring? The main policy focus seems to be on IP networks. 

Conceptual model for measuring e-business 

Ideally, we would establish a conceptual model for e-business before attempting to 
frame questions to measure it. Indeed, this was one of the goals of the December 2003 
meeting, which looked at issues such as broad frameworks, classifications and definitions. 
While a conceptual model for e-business did not emerge from that work, some 
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components of one are available from more general models of business processes (for 
instance, the Porter value chain model). A classification of e-business processes (as distinct 
from business processes) is considered problematic, partly because of the integrating 
nature of e-business. 

Model questions for measuring e-business 

The December 2003 meeting debated the definition of e-business and eventually 
concluded that, for questionnaire purposes, a definition may be less useful than targeting 
processes of particular interest for which feasible questions could be included on an 
economy-wide survey vehicle. This has therefore been the approach taken and, as a result, 
e-business questions are asked in the most appropriate way in the model questionnaire 
(Annex 5.A1). For instance, customer relation functions have been included in a question 
on website features (Question 16) and Questions 23 and 24 ask businesses that purchased 
or sold over computer networks about linkages with other systems. Note that the term 
"e-business" is not used in the model questionnaire (because it is a term that does not have 
a firm definition and is likely to be interpreted differently by different respondents). 

It is assumed that the benefits of e-business will be realised where there is a greater 
degree of integration between functions. The model questionnaire has questions on 
linkages associated with e-commerce, that is, whether systems used to receive/place 
orders over computer networks are linked with internal systems, customers' systems and/ 
or suppliers' systems. There is an emphasis on e-commerce linkages because of the 
significant interest still in e-commerce and the potential productivity gains from 
automatically linking electronic transactions with downstream processes such as 
inventory ordering, delivery, accounting functions, etc. In addition, questions such as these 
are fairly well defined in a statistical sense and have been used (though not necessarily in 
the exact form as on the model questionnaire) reasonably successfully by at least two 
member countries (the United Kingdom and Australia). 

Regarding other e-business questions, there are specific questions on use of the 
Internet in business processes in Question 16 (website functions) and Question 18 (use of 
Internet in finance, HRM (recruitment and training) and sharing and distribution of 
information [within the business and with other businesses]). 

More work needs to be done on so-called "integrated e-business processes", in 
particular, to probe areas of integration that are often referred to using terms such as 
"supply chain management", "enterprise resource planning" and "customer relationship 
management". Delegates have generally preferred not to use such terms in questionnaires 
as such technical terms present a problem in a mail-based survey where they cannot be 
explained. This is exacerbated by the fact that these terms may not be understood in the 
same way by all businesses and that the meanings themselves may change over time as 
applications become more sophisticated. 5 

Unfortunately, there are very few statistical models available on which to base 
integration questions and when the 2005 model questionnaire was being debated WPIIS 
delegates felt that the inclusion of very experimental questions on integrated e-business 
processes should be avoided at this stage. The European Commission and Eurostat are 
collecting data on e-business from 2008 (in modules on automated data exchange and 
information sharing). 
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There are several possible approaches that could be considered in measuring the use 
of integrated e-business processes. They include: 

• Directly ask the business whether it uses applications such as SCM (supply chain 
management), ERP (enterprise resource planning) or CRM (customer relationship 
management). Following the arguments presented above, the best statistical approach is 
probably to describe those processes rather than to use the precise terms and expect that 
respondents will understand them in the same way. Denmark used a descriptive 
approach in its 2005 survey to ask about use of ERP and CRM applications. However, it is 
considering changing that approach to ask about processes rather than systems. This is 
because it is thought that respondents might not uniformly understand terms that 
describe specific systems (as ICT systems could integrate several processes). The 2007 
Eurostat model questionnaire included a question on the use of ERP software and 
another on the use of CRM software. The question on ERP referred to it as a "type of 
software application" in order to avoid the difficulty of defining it. Eurostat considered 
that enterprises using ERP software would be aware of it and would be able to answer the 
question accurately. The same principle and assumptions applied to the question 
on CRM. 

• Follow the Statistics Canada approach to asking about integrated business processes. 
The questions tested by Canada 5 were: whether a browser-based system is used to 
manage functions associated with online sales, online purchases, customer relations 
and logistics. Supplementary questions asked about automatic linkages with backend 
systems, customers' systems and suppliers' systems. 

• Ask about sales and purchases transactions generally and whether those transactions 
generate an automatic update in other systems such as backend systems, customers' 
systems and suppliers' systems. This approach has the advantage that it covers all sales 
and purchase transactions not just those that constitute e-commerce. It also focuses on 
functions that are common to most businesses (that is, purchasing and selling goods or 
services). Eurostat has included such questions, on internal sales and purchase 
transactions, in its 2008 model questionnaire. 

• Consider Denmark's approach (used in its 2005 survey) for obtaining information on 
external integration. Denmark asked about the electronic exchange of data between the 
business' systems and other entities' systems. It specified that these exchanges use 
structured messages and agreed message standards. More information is provided in the 
form of a classification of the types of documents and transactions for which data are 
exchanged (they include salary transactions, electronic invoicing, product descriptions, 
transport documents, data for public authorities and financial transactions). 

All these approaches present a problem that also occurs in other areas of ICT use 
measurement and that is "how can the significance of the activity be ascertained"? It 
would almost certainly be problematic to ask businesses about the number of "linked 
transactions", their value or other measures of intensity. Therefore the data obtained 
from approaches such as those described above are generally a series of "yes/no" 
responses. This means that if a business is using particular e-business processes for a 
minor part of its business or in respect of a small number of transactions, its reply has 
the same significance as a business that has used ICT to completely transform the way it 
does all its business. 
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The Eurostat 2008 model questionnaire includes questions on the external integration 
of business processes (between different enterprises) and internal integration of business 
processes (within the enterprise). In order to measure external integration, the concept of 
automated data exchange is used (the exchange of messages via the Internet or other 
computer networks in an agreed format that allows its automatic processing without the 
individual message being manually typed). This is a concept similar to EDI although the 
term "EDI" was not used because of its interchangeable use to identify data transmission 
methodologies and types of networks. Internal integration is measured using an 
experimental concept of electronic automatic share of information on sales orders and 
purchase orders. 

ICT investment and expenditure by business 

A very readable discussion of the measurement issues in this area can be found in 
Ahmad, Schreyer and Wolfl (2004) whose paper covers: 

• the definition of ICT goods to be included in investment measures. 

• international and sectoral comparability issues; 

• software measurement (in particular, the proportion of software expenditure that is 
capitalised); and 

• price deflation of expenditure and investment (this topic is also dealt with in Chapter 2). 

Measuring Capital - OECD Manual 2009 (OECD, 2009) provides a comprehensive and up- 
to-date guide to the approaches toward capital measurement. WPIIS work has started in 
this area of measurement in partnership with the OECD's SWIC group (Statistical Working 
Party of the Committee on Industry and Business Environment). A joint expert group on 
ICT investment and expenditure has been formed and work is building on prior efforts by 
OECD and Eurostat to improve the measurement of ICT investment in the national 
accounts, notably in the area of software investment. 

Experts from 13 countries, Eurostat and the OECD participated in an expert meeting on 
the subject held in April 2004. Conceptual and methodological issues covering ICT 
investment and expenditure were discussed at length. The report of the meeting indicated 
continued work and sharing of best practice in the following areas: 

• Definitions and classifications of ICT products. The 2003 classification of ICT goods was 
considered too detailed and complicated for use in business surveys, with a more 
aggregated list preferred. The revised ICT goods classification (2007) is both less detailed 
and has a narrower scope than the previous definition. It should therefore be better 
suited for measuring ICT investment and expenditure. In addition, a classification of ICT 
services has been finalised. Both classifications are based on the CPC Version 2. 

• Software investment. Good survey data are considered essential to complement supply- 
side information. Regarding own account software, countries considered that more than 
one approach was required to develop estimates. They include asking questions in 
business surveys on labour inputs used in the production of own account software 
(e.g. FTEs, hours worked), as well as estimates of labour costs. From the national 
accounts perspective, it is important to separate own account from other types of 
software (pre-packaged and customised) since life and price characteristics differ. 
Providing estimates of bundled and embedded software was not regarded feasible, even 
though desirable. However, bundled and embedded software will be included under 
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other types of investment, notably ICT hardware. Data on leasing were considered 
problematic and could perhaps also be obtained from companies that engage in leasing. 

• Hardware investment. The main problem in this area is a lack of clear guidance on what 
should be counted as ICT and the lack of workable definitions. Focusing on broad types 
of ICT hardware e.g. networked technologies or technologies that primarily process 
information was considered useful. The follow-up work on definitions and 
classifications can help address this problem. Bundled and embedded hardware would 
typically be included in other investment categories, but this is standard practice with 
investment data - for example, an elevator would be considered part of a building, not a 
separate piece of equipment. Another important problem that was noted was the 
difficulty in unbundling hardware investment from computer services and consultancy, 
e.g. in counting the investment related to installing a large computer system. Firms 
typically have difficulty in separating such information. To help address this issue, the 
group noted the importance of having more data and experience on current expenditure, 
to complement the information on investment. 

• Survey issues. Countries have a diversity of survey instruments that capture information 
on ICT investment and expenditure. Most countries use the enterprise as the core 
statistical unit, although some countries also have good experience with the 
establishment. It is thought that establishments may know better when equipment is 
being installed and may know more about current expenditure, while enterprises may 
know more about investment. Where countries collect information on both ICT 
expenditure and investment, it was considered helpful to do this in the same survey, as 
this would ensure consistency, for example, regarding the definitions used. 

• Inconsistency between firm accounting standards and national accounting rules. In 

many cases, problems in measuring ICT investment and expenditure were linked to 
differences between firm accounting standards and statistical rules, including national 
accounting rules. This problem was considered beyond the scope of the expert group, 
but could be addressed by the OECD in other work, for example, planned work on 
intangibles. 

The WPIIS meeting of 2005 included a session devoted to this topic and delegates 
provided updates on their work in resolving the issues outlined above. Issues that were 
discussed included: 

• separating expenditure on hardware and software where they are bundled into a single 
product; 

• measurement of international trade in computer software; 

• methods for modelling or directly measuring investment in own account software; 

• production of ICT products outside the ICT sector; and 

• the appropriate classification of ICT goods. 

Several countries have done work in this area, including: Australia's work on 
compiling an ICT satellite account; Denmark's survey on ICT expenditures and 
investments; the work by the United Kingdom in confronting and adjusting existing data 
on ICT capital expenditure; and Eurostat's work on surveys of ICT investment and 
expenditure in the private and public sectors. 
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The economic impacts of ICT investment and ICT use 

Investment in ICT contributes to capital deepening and can therefore help raise labour 
productivity. The use of ICT throughout the economy may also help firms increase their 
overall efficiency, thus raising multi-factor productivity (MFP) growth. Moreover, ICT use 
may contribute to network effects, such as lower transaction costs and more rapid 
innovation, which should also improve MFP. 

Empirical analysis 

These impacts can be examined at different levels of analysis, that is, using 
macroeconomic data, industry data or data at the level of individual firms or establishments. 

Several studies have examined the impact of ICT at the macroeconomic level 
(e.g. Colecchia and Schreyer, 2001; van Ark et al., 2003; Jorgenson, 2003; Schreyer et al., 
2003). These studies show that ICT investment contributed to capital deepening and 
growth in most OECD countries in the 1990s, though with considerable variation across 
countries. ICT investment typically accounted for between 0.3 and 0.9 percentage points of 
growth in GDP per capita over the 1995-2003 period (OECD, 2005). Sweden, Denmark, 
Australia, the United States and the United Kingdom received the largest boost; Canada 
and Japan a more modest one, and Germany, France and Italy a much smaller one. 

Several studies have also been undertaken at the industry level (Pilat et al., 2002; 
O'Mahony and van Ark et al., 2003; Pilat and Wolfl, 2004) and some have distinguished 
an ICT-using sector, composed of industries that are intensive users of ICT. Examining 
the performance of these sectors over time and comparing them with sectors of the 
economy that do not use ICT may help point to the role of ICT in aggregate 
performance. Studies along these lines show that ICT-using services in the United 
States and Australia experienced an increase in productivity growth in the second half 
of the 1990s, which seems partially associated with their use of ICT. Few other countries 
have thus far experienced similar productivity gains in ICT-using services (OECD, 2003). 
Moreover, the European Union lags behind the United States in this sector (O'Mahony 
and van Ark, 2003). 

Over the past decade, analysis of the impact of ICT use has also benefited from the 
establishment of longitudinal databases in statistical offices. These databases allow firms 
to be tracked over time and may contain information from several surveys and data 
sources. They typically cover large and statistically representative samples of firms, which 
is important given the enormous heterogeneity in firm characteristics and performance 
(Bartelsman and Doms, 2000). In recent years, longitudinal databases have increasingly 
incorporated links to data on firm use of ICT; the linked data can subsequently be explored 
in analytical studies. Other types of data can be integrated too, which is important since 
empirical studies suggest that the impact of ICT depends on a range of complementary 
investments and factors, such as the availability of skills, organisational factors, 
innovation and competition (OECD, 2003). 

The evidence emerging from firm-level studies suggests that the use of ICT does have 
positive impacts on firm performance and productivity, even in countries and industries 
for which little evidence is available at more aggregate levels of analysis (OECD, 2004; Pilat, 
2005). However, these impacts occur primarily, or only, when accompanied by other 
changes and investments. For example, many empirical studies suggest that ICT primarily 
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benefits firms where skills have been improved and organisational changes have been 
introduced. Another important factor is innovation, since users often help make 
investment in technologies, such as ICT, more valuable through their own experimentation 
and invention. Without this process of "co-invention", which often has a slower pace than 
technological invention, the economic impact of ICT may be limited. The firm-level 
evidence also suggests that the uptake and impact of ICT differs across firms, varying 
according to size of firm, age of the firm, activity, etc. 

Measurement and comparability 

The measurement of the economic impacts of ICT investment at the aggregate level is 
relatively straightforward and has been outlined in detail in Colecchia and Schreyer (2001) 
and Schreyer et al. (2003). It is based on growth accounting, which involves the estimation 
of the productive capital stock, followed by the estimation of the capital services flowing 
from that stock. The method can be applied at both the macroeconomic and industry level, 
providing the appropriate data are available. One important element in this respect 
is having the appropriate deflators for ICT investment that adjust for quality change, i.e. 
so-called hedonic deflators. To address problems of international comparability, empirical 
studies often use United States hedonic deflators to represent price changes in other 
countries. This is only a second-best solution as countries should ideally develop deflators 
that properly account for quality change of ICT products in their own national context. A 
particularly important area is hedonic deflators for software investment; the United States 
is one of the few OECD countries to use hedonic deflators for pre-packaged software. For 
more information, readers are referred to the Handbook on Hedonic Indexes and Quality 
Adjustments in Price Indexes: Special Application to Information Technology Products (Triplett, 
2004) and Chapter 2 of this Guide (The price and quality of ICT products). 

Another challenge concerns the basic data; measures of ICT investment are not 
available for all OECD countries and when they are, they are not necessarily comparable 
across countries. Data on software investment are particularly problematic since countries 
vary in how much total software spending is counted as investment. Measuring software 
has been the subject of an OECD/Eurostat Taskforce that has produced a range of 
recommendations to improve measurement (see Ahmad, 2003). Measurement of ICT 
investment and expenditure by business is also a current concern of the WPIIS. See the 
previous section of this chapter for details. 

Several problems also affect the measurement of productivity in ICT-using services 
(Wolfl, 2003). First, output measures are not straightforward. There is little agreement, for 
example, on the output of banking, insurance, medical care and retailing. In addition, some 
services are not sold in the market, so it is hard to establish prices. In practice, these 
constraints mean that output in some services is measured on the basis of relatively 
simple indicators. Moreover, best practices in measuring services output have not yet 
spread widely. While some new approaches to measurement in these sectors are being 
developed (Bosworth and Triplett, 2003), only few countries have thus far made substantial 
changes in their official statistics to improve measurement. Work is underway at OECD in 
some areas, e.g. finance and insurance. 

Future developments 

Solid evidence on the economic impacts of ICT, and the conditions under which these 
impacts occur, is important in underpinning evidence-based policy formulation. Therefore, 
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further progress in both measurement and economic analysis is feasible and desirable. One 
important area concerns the measures of economic impacts that are available at the 
aggregate or industry level. This will require more comparable investment data, a greater 
use of quality-adjusted deflators, including for software investment, and improved output 
measures for services. Much more analytical work can also be done, e.g. in linking ICT 
investment more systematically to economic impacts, for example through regression 
analysis at the aggregate or industry level. 

However, the largest potential for further work probably lies with firm-level data. 
There are at least two aspects to this. First, cross-country studies on the impact of ICT at 
the firm level are still relatively scarce, primarily since comparable data sources are still 
relatively new. Some studies have engaged in international comparisons (Atrostic et al., 
2004; Hempell et al., 2004; Haltiwanger et al., 2003). Understanding the reasons for the 
cross-country differences in the impacts of ICT reported in such studies would benefit from 
further work, and could lead to helpful insights for policy. 

Second, there are several key issues that remain poorly analysed and that offer scope 
for progress. For example, further work with firm-level data could provide greater 
insights into the contribution of firm dynamics to productivity gains, e.g. the role of new 
firms, the conditions that lead to successful survival and the factors determining firm 
exit. Moreover, the link between innovation and ICT has only been examined for some 
OECD countries. Understanding this link is of great importance as long-term growth 
largely depends on the future pace of innovation. Moreover, quantitative analysis of the 
price and productivity impacts of e-commerce and e-business processes more broadly is 
still in its early stages, but is a promising area of further work, as suggested in a study for 
the United Kingdom (Clayton et al., 2004). Finally, while there is good evidence for some 
OECD countries that ICT can help transform the service sector and make it more 
innovative and productive, a good understanding of ICT's impact on the service sector is 
still lacking, partly because of the measurement problems outlined above but also due to 
lack of cross-country empirical analysis. 

Recent work in this area is summarised in a paper prepared for the 2007 WPIIS 
meeting (OECD, 2007a). 

Subjective measurement of impacts 

Another approach to measuring impacts of ICT on firm performance is to ask firms 
directly about those impacts. While this approach offers the advantage of providing 
direct causal information, it is usually considered less objective than the empirical 
measurement techniques outlined above. A number of OECD countries include impacts 
questions in their national surveys of ICT use/e-commerce. Such questions typically ask 
about the benefits of particular ICTs such as Internet commerce technologies for 
purchasing or selling goods or services. 

The OECD model survey of ICT use by businesses includes a question on the benefits 
of selling over the Internet (see Question 13 of the model questionnaire in Annex 5.A1). 
Response categories for the question include: reduced transaction time, increased quality 
of customer service and lower business costs. 

Similarly, the 2008 Eurostat model questionnaire includes a question on the perceived 
benefits of the use of ICT. The approach is different as the question is not directed to the 
benefits of the use of a specific technology, but the benefits of ICT projects in general. The 
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implementation of an ICT project refers to the introduction of a new or updated ICT (e.g. a 
new/updated software application or new/updated hardware) or a change in the use of an 
existing ICT. Examples of ICT projects are: a new or a restructured website, a new internal 
homepage, starting use of automated data exchange or starting to receive orders via 
computer networks. The goal is to cross-tabulate the results on benefits with the use of 
several ICTs. 



Notes 

1. Denmark, Finland, Iceland, Norway and Sweden. 

2. Nordic Council of Ministers: Guidelines for Measuring use of Information and Communication Technology 
(ICT) in Enterprises - a first step towards harmonised Nordic Surveys, Copenhagen 1998. 

3. World Summit on the Information Society meetings. OECD contributed to a list of core ICT 
indicators that could be used by countries following final agreement. The core indicators were 
agreed to by a WSIS meeting held in Geneva in February 2005. 

4. Model questionnaire for the Community Survey on ICT Usage and e-Commerce in Enterprises, 
2006. 

5. The testing consisted of 26 cognitive interviews with a selection of respondents from the 2004 
Statistics Canada Suruey of Electronic Commerce and Technology. The work was undertaken with the 
support of WPIIS and one of its aims was to provide input to the work on revising the OECD model 
survey. 

6. This material is taken from the final model survey paper of 2005 (OECD, 2005). 

7. ISIC is the International Standard Industrial Classification of all Economic Activities. According to 
ISIC, an enterprise has "autonomy in respect of financial and investment decision-making, as well 
as authority and responsibility for allocating resources for the production of goods and services. It 
may be engaged in one or many productive activities. The enterprise is the level at which financial 
and balance sheet accounts are maintained and from which international transactions, and 
international investment position (when applicable) and the consolidated financial position can be 
derived." 

8. Defined by the European Commission as: "...the smallest combination of legal units that is an 
organisational unit producing goods or services, which benefits from a certain degree of autonomy 
in decision-making, especially for the allocation of its current resources. An enterprise carries out 
one or more activities at one or more locations. An enterprise may be a sole legal unit." 

9. Analyses done by Statistics Finland and Statistics Netherlands on the impact of different 
weighting methodologies have found that ratio estimation by turnover resulted in a higher figure 
for e-commerce value than number raised estimation. However, the difference is not thought to be 
statistically significant. 

10. These are financial and non-financial corporations following the concepts of the SNA 1993. Such 
corporations are "institutional units which are principally engaged in the production of market 
goods and non-financial services" and include corporations "subject to control by Governments". 

11. According to the SNA 1993 "The general government sector consists of the totality of institutional 
units which, in addition to fulfilling their political responsibilities and their role of economic 
regulation, produce principally non-market services (possibly goods) for individual or collective 
consumption and redistribute income and wealth". 

12. All ISIC references in this annex are to ISIC Rev. 3.1. 

13. NACE is the Statistical Classification of Economic Activities in the European Community, Rev. 1.1 
(2002). All NACE references in this annex are to NACE Rev. 1.1. 

14. In respect of Section H, Hotels and restaurants, about half the countries which do the Eurostat 
survey collect data for the remaining NACE categories 55.3 to 55.5 (restaurants, bars, etc.). 

15. Not all countries that do the Eurostat survey collect data for all classes of Section O (Other 
community, social and personal service activities). For collection purposes, divisions 92 and 93 are 
most relevant. 
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16. Eurostat developed a specific module of the enterprise survey for a pilot study of this sector in 
2004. In 2005, the Eurostat model questionnaire was revised but limited to general ICT variables. 
For 2006, the model questionnaire was improved and included questions on e-commerce. 

17. Countries should note that the broader the scope, the larger the sample size generally required to 
obtain adequate aggregate estimates. Extending the scope to employing businesses with fewer 
than 10 employees might increase the sample size by a factor of two or more. 

18. Even though the incidence of Internet access by devices other than computers is currently low, it 
may increase with improvements in mobile phone technology (such as 3G). 



References 

Ahmad, N. (2003), "Measuring Investment in Software", STI Working Paper 2003/6, OECD, Paris. 

Ahmad, N., P. Schreyer and A. Wolfl (2004), "ICT Investment in OECD Countries and its Economic 
Impacts", The Economic Impact of ICT - Measurement, Evidence and Implications, OECD, Paris, 
pp. 61-83. 

Atrostic, B.K. et al. (2004), "IT, Productivity and Growth in Enterprises: Evidence from New International 
Micro Data", The Economic Impact of ICT - Measurement, Evidence and Implications, OECD, Paris. 

Bartelsman, E.J. and M. Doms (2000), "Understanding Productivity: Lessons from Longitudinal Micro 
Datasets", Journal of Economic Literature, Vol. 38. 

Bosworth, B.P. and J.E. Triplett (2003), "Services Productivity in the United States: Griliches" Services 
Volume Revisited", paper prepared for CRIW Conference in Memory of Zvi Griliches, Brookings 
Institution, Washington DC. 

Clayton, T. et al. (2004), "Enterprise E-commerce: Measurement and Impact", The Economic Impact o/ICT 
- Measurement, Evidence and Implications, OECD, Paris. 

Colecchia, A. and P. Schreyer (2001), "The Impact of Information Communications Technology on 
Output Growth", STI Working Paper 2001/7, OECD, Paris. 

Haltiwanger, J., R. Jarmin and T. Schank (2003), "Productivity, Investment in ICT and Market 
Experimentation: Micro Evidence from Germany and the United States", Center for Economic Studies 
Working Paper CES-03-06, US Bureau of the Census, Washington, DC. 

Hempell, T, G. van Leeuwen and H. van Der Wiel (2004), "ICT, Innovation and Business Performance in 
Services: Evidence for Germany and the Netherlands", The Economic Impact of ICT - Measurement, 
Evidence and Implications, OECD, Paris. 

Jorgenson, D.W. (2003), "Information Technology and the G7 Economies", Harvard University. 

O'Mahony, M. and B. van Ark (eds.) (2003), EU Productivity and Competitiveness: An Industry Perspective - 
Can Europe Resume the Catching Up Process?, European Community, Luxembourg. 

OECD (2001), "Measuring ICT Usage and Electronic Commerce in Enterprises: Proposal for a Model 
Questionnaire", Working Party on Indicators for the Information Society, DSTI/ICCP/IIS(2001)1/ 
REV1, OECD, Paris, u>u>u;.oecd.org/dataoecd/3/6/20628443.pdf. 

OECD (2003), ICT and Economic Growth - Evidence from OECD Countries, Industries and Firms, OECD, Paris. 

OECD (2004), The Economic Impact of ICT - Measurement, Evidence and Implications, OECD, Paris. 

OECD (2005), OECD Compendium of Productivity Indicators - 2005, OECD, Paris. 

OECD (2007), "Measuring the impacts of ICT using official statistics", Working Party on Indicators for 
the Information Society, DSTI/ICCP/IIS(2007)1/FINAL, OECD, Paris, tuuJu;.oecd.org/dataoecd/43/25/ 
39869939. pd/. 

OECD (2009), Measuring Capital - OECD Manual 2009: Second edition, OECD, Paris. 

Pilat, D. (2005), "The ICT Productivity Paradox: Insights from Micro Data", OECD Economic Studies, No. 38, 
2004/1, pp. 37-65. 

Pilat, D. and A. Wolfl (2004), "ICT Production and ICT Use - What Role in Aggregate Productivity 
Growth?", The Economic Impact of ICT - Measurement, Evidence and Implications, OECD, Paris. 

Pilat, D., F. Lee and B. Van Ark (2002), "Production and Use of ICT: A Sectoral Perspective on Productivity 
Growth in the OECD Area", OECD Economic Studies, No. 35, Paris, pp. 47-78. 



84 OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



5. ICT DEMAND BY BUSINESSES 



Schreyer, P., P. Bignon and J. Dupont (2003), "OECD Capital Services Estimates: Methodology and A First 
Set of Results", OECD Statistics Working Paper 2003/6, OECD, Paris. 

Triplett, J. (2004), "Handbook on Hedonic Indexes and Quality Adjustments in Price Indexes: Special 
Application to Information Technology Products", STI Working Paper 2004/9, OECD, Paris, 
www.oecd.org/dataoecd/3 7/3 1/33 789552 .pd/. 

Van Ark, B. et al. (2003), "ICT Investments and Growth Accounts for the European Union, 1980-2000", 
Research Memorandum GD-56, Groningen Growth and Development Centre, Groningen. 

Wolfl, A. (2003), "Productivity Growth in Service Industries: An Assessment of Recent Patterns and the 
Role of Measurement", STI Working Paper 2003/6, OECD, Paris. 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



85 



5. ICT DEMAND BY BUSINESSES 



ANNEX 5.A1 



OECD Model Suruey of ICT Use by Businesses 

Introduction 

This annex is based on a number of papers presented to the WPIIS and records of 
discussion at WPIIS meetings. The main sources are the 2001 paper presented to ICCP that 
proposed declassification of the model survey. 

It should be noted that OECD has benefited from the work of Eurostat, the statistical 
office of the European communities, and those member countries that have been 
prominent in this area of measurement. Many have provided invaluable assistance to the 
lead country (Denmark) in developing the 2001 model survey and to the OECD Secretariat 
in revising the model in 2005. 

Of note, the 2005 OECD model survey of ICT use by businesses does not take into 
account the 2010 revision of the OECD statistical definition of e-commerce. At its 2010 
meeting, WPIIS agreed to update the model survey of ICT use by businesses for the 2011 
meeting. 

History of the model survey's development 

The WPIIS started work in this area in 1999, with a stocktaking of country 
measurement practices prepared by Sweden and presented to the April 1999 meeting. The 
surveys of Statistics Denmark and Statistics Finland in 1998-1999 resulted in a draft 
proposal for a model survey being presented at the Voorburg Group on Services Statistics 
meeting in Christchurch (October 1999). With input from the Voorburg Group, a revised 
model survey was developed and tested in 1999-2000 by Statistics Denmark, Statistics 
Finland, Statistics Norway and Statistics Sweden. 

A model questionnaire on the use of ICT products by the business enterprise sector 
was first presented to the WPIIS by Denmark in 2000 and was based on work done by the 
statistical offices of the Nordic countries 1 that were the first countries to establish a project 
for a common set of guidelines for measuring ICT use in enterprises. 2 The results from 
these surveys, together with experiences from similar surveys carried out by the Australian 
Bureau of Statistics, Statistics Canada and the Department of Trade and Industry (DTI) in 
United Kingdom, combined with the discussions at the WPIIS meeting in April 2000, 
formed the input to the revision of the model questionnaire that was discussed at the 
Voorburg Group meeting in Madrid (September 2000). New lessons were drawn from the 
2000-2001 survey in the Nordic countries, the Eurostat pilot survey launched in the same 
period and the 2000 surveys of Statistics Canada and the Australian Bureau of Statistics. 
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Another round of discussion at the April 2001 WPIIS meeting and subsequent written 
comments led to a final proposal that was presented to WPIIS' Parent Committee ICCP for 
declassification (approval) in October 2001. 

A number of aspects of the measurement of ICT use and e-commerce by business were 
discussed at WPIIS and expert Group meetings after the model survey was approved in 
2001. The content of the model questionnaire was always intended to be dynamic, with the 
2001 proposal stating that "As technology and policy priorities evolve, the model 
questionnaire will need to be reviewed and adapted over time". 

Additionally, the 2001 proposal outlined outstanding methodological issues needing to 
be addressed "... to ensure the comparability of the statistics obtained via the proposed 
model questionnaire". Those issues included weighting of data according to common 
principles, harmonisation of the concept of income used when measuring the monetary 
value of electronic transactions and the collection unit used in each country. 

The 2002 WPIIS meeting discussed a number of enhancements to the model survey 
and established two expert groups to consider measurement issues for e-business and the 
finance sector. The 2003 meeting considered reports from the two groups and agreed to 
continue work on e-business as a priority area. After some discussion, delegates agreed not 
to pursue work on the finance sector but instead to monitor Eurostat's efforts in this area. 

An OECD workshop on the measurement of e-business was held in December 2003 
and involved statisticians, analysts, policy makers and businesses. A subsequent expert 
Group meeting was held in April 2004 and the topic was followed up at the 2004 WPIIS 
meeting. 

The 2004 WPIIS meeting considered a Secretariat proposal for a revision of the model 
survey that was intended to ensure that it reflected current policy needs and was 
reasonably aligned with country survey practices. The proposal suggested including survey 
methodology and scope in the new model and suggested new topics such as IT security 
and e-business. 

A detailed proposal, developed by the Secretariat in consultation with interested 
member countries, was presented to the 2005 meeting and subsequently revised based on 
comments made at, and following, the meeting. 

The revised model was finalised in late 2005 and distributed as DSTI/ICCP/IIS(2005)2/ 
FINAL (OECD, 2005a). 

Development of the revised model of 2005 

In order to prioritise material to be included in the revised model survey, content was 
examined from both an output and an input perspective. Regarding output, reference was 
made to the OECD list of core e-commerce indicators, agreed at the 2000 WPIIS meeting, 
and data that OECD has been able to collect from member countries. A core list of ICT 
indicators currently proposed for use by non-OECD member countries (per the WSIS 3 
meetings) was also consulted in order to ensure as many options as possible for future 
benchmarking across a greater number of countries. 

Regarding input, survey material from a number of member countries was examined, 
including the Eurostat questionnaire for 2006. 4 

New questions were considered based on known policy needs and, as far as possible, 
the experiences of member countries in asking those questions in their surveys. 
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Ultimately, because of the nature of the revisions, some questions that are relatively 
untested by member countries were included in the model. Parts of the questionnaire are 
therefore considered somewhat experimental (for more information, see the section below 
on non-core questions and the footnotes to the questionnaire). 

An important criterion applied at each stage, was to try to minimise the number and 
complexity of the questions. This is in recognition of the high cost of collecting these data 
in terms of expense and respondent load. 

Comments were sought on the 2004 and 2005 proposals from all WPIIS delegates. A 
number of countries and organisations responded and their comments were incorporated 
into the model as far as possible. 

In addition, some question testing work by Statistics Canada was completed during 
this period and the results taken into consideration for the revised model questionnaire. 5 
The Statistics Canada test included questions on IT security, interaction with government 
and deployment of e-business processes in the areas of marketing and customer relations, 
sales, purchases, logistics, and financial and human resource management. 

The model survey consists of a number of elements that are described further below. 
They include: survey methodology; scope and coverage; classificatory variables; particular 
statistical issues associated with business ICT access and use measurement; comparison 
with Eurostat's model survey; and a model questionnaire (including definitions of terms 
and metadata notes). 6 

Survey methodology 
Introduction 

The 2001 model did not contain specific methodological recommendations and 
pointed out the need to do further work in this area. Particular areas cited were weighting 
methodology and collection units. Other methodological issues have since been raised in 
expert Group and Eurostat Task Force meetings, including: sample design and size, 
validation rules, outlier treatment and non-response treatment. Additional areas falling 
under the general umbrella of "survey methodology" include: data collection methods and 
survey vehicles, population frame (or list), whether collections should be mandatory, data 
processing (editing, imputation, and estimation), survey frequency, reference period and 
date. 

The model survey does not attempt to cover all these areas, for two reasons: 

• Feedback from delegates indicated that methodological recommendations should be 
kept broad because member countries generally have established procedures for 
conducting business ICT use surveys. 

• The publication in late 2005, and thereafter annually, of a methodological manual for 
Eurostat's Community Suruey on ICT Usage and E-commerce in Enterprises. This manual 
details recommendations for countries that undertake the Community Survey and deals 
in detail with methodological issues such as sample design, validation rules, non- 
response treatment, weighting and so on (Eurostat, 2010a). 
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Minimising sampling and non-sampling error 

In general, countries should note that differences in survey methodologies can lead to 
inconsistencies in output. All countries should therefore aim to reduce sampling and non- 
sampling error ("bias") as much as possible by: 

• using a population frame that accurately reflects the target population (therefore which 
is up-to-date and representative); 

• using well-designed samples that are of sufficient size to produce reliable data (that is 
having low standard errors for the aggregates suggested in this paper); 

• careful design and testing of questions, definitions and question sequences; 

• reducing unit and item non-response rates as far as possible (by, for example, using well 
designed questionnaires and following up outstanding responses); and 

• minimising errors arising from data entry, editing and other data processing (by 
appropriate staff training and documentation). 

Survey vehicles 

There is a variety of survey vehicles that could be used to collect data on business ICT 
use. Most OECD countries conduct dedicated surveys on ICT use, but countries that do not 
have such a vehicle could add questions to an existing economy-wide survey or to separate 
industry surveys (where they can collectively cover the industry scope required for ICT use 
data). 

Collection techniques 

Most OECD countries use mail-out/mail-back surveys for collecting data on business 
use of ICT. However, the information could also be collected by means of personal 
interview (face-to-face or telephone) or other methods such as drop-off/call-back (or post 
back). Electronic data capture may be viable for some respondents, though with one or two 
exceptions, OECD countries are not yet using this technology. 

Statistical unit 

The following discussion refers to the unit about which data are collected. This may be 
different from the unit that reports the data (the "reporting unit"). The OECD and Eurostat 
both specify the "enterprise" as the statistical unit and this is the unit used by most OECD 
countries. Choice of unit is important as it influences the results obtained. As output from 
ICT use surveys is mainly proportions data, comparability between countries is more likely 
to be attained where the unit chosen is the same. As an example, if country A uses the 
establishment as a unit and country B uses the enterprise, then it is likely that country B 
will report higher proportions, especially of more sophisticated uses, such as buying and 
selling over the Internet, or use of an intranet. Another example is that units of a lower 
order (for instance, establishments) within a larger entity may do more external e-commerce 
(within the entity) than higher order units such as enterprises. 

Unfortunately, there is no single definition of an enterprise that is used by all 
countries. The two main definitions are those of the ISIC (Rev. 3.1) 7 and the European 
Union. 8 While they have common characteristics that enterprises exercise a certain degree 
of autonomy in decision making, the EU concept is narrower and it is suggested that this 
concept be used where possible. 
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It is important not to confuse the enterprise unit with the "legal unit" entity. While 
legal units are independent in a legal sense, they may not necessarily constitute 
independent economic entities with decision-making autonomy for their productive 
activities. 

Like most other business surveys conducted by national statistical offices, those 
measuring business ICT use are national surveys of businesses operating in the country. 
They therefore include enterprises located in the country but which are part of a 
multinational group (note that only the domestic part of the multinational should be 
included). 

Survey frequency and reference period/date 

There is perhaps a greater requirement than for household surveys for the frequency 
of business surveys to be sensitive to the evolution of ICT and its use. It is probably 
unrealistic to expect countries to conduct surveys more frequently than annually. For some 
countries, even an annual collection will not be feasible, in which case it is important that 
those countries try to align their collection years as far as possible. As much of the 
information collected is point-in-time data, it would be preferable to also have alignment 
of reference dates across participating countries. 

Weighting methodologies 

The subject of weighting of survey estimates was noted as an outstanding issue in the 
first model survey paper (OECD, 2001) and has been raised at expert Group meetings as an 
area to be further explored. In particular, debate has centred on the merits of employment- 
weighted estimation. In an attempt to clarify the technicalities of weighting 
methodologies, the main methods employed by member countries are briefly described 
below. 

Number-raised weighting (or estimation) 

This involves applying a unit weight to each selected business unit according to the 
total number of units in its stratum. For instance, if there are 100 businesses in a selected 
unit's stratum and 20 are selected, the selected unit's weight is 5 (that is, 100 divided by 20) 
which means that the unit represents five businesses in the population (itself plus four 
others). Algebraically, the weight is depicted by N^/n^, where is the total number of 
units in stratum h and n ^ is the number of sampled units in stratum h. 

The technique is applicable to both qualitative (for our purposes, usually "yes/no") and 
numerical variables (those whose elements are numbers such as a percentage or an 
absolute value). In the case of numerical variables whose value is a percentage (for 
instance, the percentage of income earned through selling over the Internet), the value is 
first converted to an absolute ualue (for this example, the percentage is converted to a fraction 
(that is, divided by 100) then multiplied by the unit's total income to yield the value of 
income earned through selling over the Internet). The absolute value is then treated like 
any other value. 

The population estimate is derived by first weighting up unit values in stratum h (that 
is, multiplying each of them by the stratum weight, N^/n^) and then adding all the 
weighted unit values in the stratum. This is done for each stratum and then stratum totals 
are aggregated to calculate the population estimate. 
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Ratio estimation 

This technique uses a benchmark (or auxiliary) variable, such as employment or 
income in addition to the variable of interest. The benchmark variable should be highly 
correlated with the variable of interest and needs to be known for all units in the 
population. The ratio estimate is calculated, for each stratum, by weighting each unit's 
value by a factor equal to the sum of values of the benchmark variable for all units in the 
stratum divided by the sum of values of the benchmark variable for all selected (sample) 
units in the stratum. This technique would be suitable for a numerical variable, for 
instance, estimating e-commerce sales value using total turnover as the benchmark 
variable. 

As before, weighted values of units in stratum h are aggregated across the stratum and 
stratum totals are added to calculate the population estimate. 

Economically-weighted estimation 

Employment weighting is an example of this type of estimation. In general, it is an 
estimation technique that gives more weight to larger units. It is typically used for 
qualitative variables and produces output of the type: businesses with a website account 
for (or represent) x% of total employment. 

The estimates are calculated for each unit in stratum h, by multiplying the unit's value 
(0 or 1 for a "yes/no" variable) by its stratum weight (N^/n^) and by the value of the auxiliary 
variable (usually employment or turnover). The resulting values are aggregated across the 
stratum and then stratum totals are added. 

Country practice 

Most OECD countries appear to use number-raised weighting for qualitative variables 
and either number-raised or ratio estimation for numerical variables. Both of these 
estimation techniques are designed to give population estimates of the type "proportion of 
businesses using the Internet" or "value of income derived from Internet sales". 
Theoretically, the techniques should yield fairly similar results. 9 

In addition, some countries present output derived by economically weighted 
estimation. Estimates resulting from this technique provide valuable but quite different 
information from the other two types of estimation. It is suggested that countries that use 
economically weighted estimation should make it quite clear to users what such an 
estimate means. For instance, the difference between a number-raised and economically- 
weighted estimate relating to whether businesses have websites can be significant 
(in Canada, in 2004, 37% of businesses had a website, but they accounted for 85% of total 
business revenue for Canada). 

Scope and coverage 
Introduction 

In practice, survey scope varies between countries, with notable differences in both 
industry and size scope. The scope of business surveys is commonly defined by type of 
organisation, industry (activity), size and geography. The scope of the 2001 OECD model 
survey was not specified but it was described as an economy-wide survey of business 
enterprises. However, some guidance on scope was offered for the 2005 revision of the 
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model. It derives from the practical experience of OECD in data collection from member 
countries and from Eurostat in its specifications for its model survey. Details are outlined 
below. 

Type of organisation 

Whilst not specified in the 2001 OECD model, this will usually be businesses from the 
private and public sectors 10 that are operating in the country conducting the survey. 
General government organisations 11 are excluded. Most OECD countries also exclude non- 
employers. 

Industry (actiuity) scope 

It is important for comparability purposes to have a reasonably consistent industry 
scope, as some industries are less ICT intensive than others. Most OECD member countries 
collect business ICT use data from businesses in the following industries: Manufacturing 
(ISIC D), Construction (ISIC F), Wholesale and retail trade; repair of motor vehicles, 
motorcycles and personal and household goods (ISIC G), Hotels and restaurants (ISIC H), 
Transport, storage and communications (ISIC I) and Real estate, renting and business 
activities (ISIC K). 12 

Eurostat specifies a scope of NACE 13 Sections D, F, G, H (55.1 and 55.2 only), 14 I, K and 
O (92.1 and 92.2 only). 15 Industries that Eurostat states as optional are: E, 55.3-55.5, 92.3- 
92.7 and 93. 

In respect of Financial intermediation (ISIC J), 16 Eurostat includes NACE classes 65.12, 
65.22, 66.01 and 66.03. 

Based on industries included in member country surveys, the following minimum 
scope is feasible for most countries: ISIC Sections D, F, G, H, I and K. In addition, Section J 
has been included in scope but as a non-core sector. ISIC Division 92 (recreational, cultural 
and sporting activities) has also been added as a non-core sector because of interest in this 
area. This leads us to an industry scope as follows: 

• manufacturing (ISIC D); 

• construction (ISIC F); 

• wholesale and retail trade; repair of motor vehicles, motorcycles and personal and 
household goods (ISIC G); 

• hotels and restaurants (ISIC H); 

• transport, storage and communications (ISIC I); 

• financial intermediation (ISIC J) (non-core); 

• real estate, renting and business activities (ISIC K); and 

• recreational, cultural and sporting activities (ISIC Division 92) (non-core). 

Size scope 

Most OECD countries specify that in-scope businesses are employers and they define 
size scope in terms of number of employees. Eurostat specifies a size cut-off of 10 or more 
employees. For comparability, OECD does likewise when collecting data even though there 
is a range of cut-offs used among OECD (including European) countries, with at least two 
member countries including enterprises with a single employee. It is suggested that the 
size scope recommendation for the model survey be 10+ employees consistent with 
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Eurostat. However, it is recognised that there are important policy issues pertaining to 
businesses that are smaller than this. Countries are therefore encouraged to extend the 
scope to include smaller businesses where they have a policy need and resources permit. 17 

Geographic scope 

The 2001 OECD model did not specify a geographic scope, while Eurostat specifies that 
the whole country is in scope. It is presumed that this scope applies generally to member 
countries so it has been explicitly adopted for the OECD model. The geographic scope 
therefore encompasses businesses operating anywhere in the reporting country. 

Coverage 

Coverage refers to departures from scope and describes the situation where in-scope 
businesses are not liable to selection in the survey. There are various reasons this could 
occur and they include inaccessibility of part of the population in a physical sense or 
undercoverage arising from an incomplete population frame. Where undercoverage exists, 
it is useful if countries advise of any significant impact on survey estimates. 

Classificatory variables 

The 2001 and revised OECD model questionnaires recommend collection of 
information on business industry and size (number of employees). While different industry 
classifications are used by countries, in practice, the results are reasonably concordable at 
the broad level at which the OECD publishes them. 

Some classificatory data may be collected as part of the survey in cases where the 
information is not available from other sources (such as the population frame or another 
survey). Three questions have been included for this purpose in Section C of the model 
questionnaire. A minimal set of classification variables and categories based on practices 
of OECD countries is suggested below. This is consistent both with advice offered by 
Eurostat for collection of business use of ICT data and the scope recommendations 
presented above. 

Countries may use extra classificatory variables and/or additional categories. In 
particular, countries where a rural/urban divide exists may wish to add a geographic 
classification, though none has been specified for the OECD model. In practice, classifying 
units to regions within a country can be difficult as multi-unit businesses do not usually 
split their operations evenly between regions. For instance, head office operations will tend 
to be in major cities, but represent national activities. 

The following classificatory variables are recommended for the model survey. 

Industry (activity) 

A broad industry output classification consistent with the suggested industry scope 
is: Manufacturing (ISIC D); Construction (ISIC F); Wholesale trade (ISIC 51); Retail trade 
(ISIC 52); Hotels and restaurants (ISIC H); Transport, storage and communications 
(ISIC I); Financial intermediation (ISIC J) (non-core); Real estate, renting and business 
activities (ISIC K); and Recreational, cultural and sporting activities (ISIC Division 92) 
(non-core). 
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Size (number of employees) 

The recommended size categories align with those of Eurostat and OECD data 
collection categories. They are as follows: 

• 10-49 employees. 

• 50-249 employees; and 

• 250 employees or more. 

Countries are encouraged to further disaggregate the top category when producing 
output. Use of some ICTs (in particular relating to e-business) is likely to be more prevalent 
in very large businesses. 

Particular statistical issues associated with business ICT use measurement 

Arguably, the main areas of difficulty in ICT use measurement are e-business and 
e-commerce. These are discussed in some detail in Chapter 5 so are not covered in this 
annex. The measurement of e-government is also challenging - see the article in this 
annex. Other measurement issues are discussed below. 

Trust in the online environment 

A fundamental element in enabling the benefits ICT can bring to the economy and 
society is the confidence users have in platforms, applications and services. Creating an 
online environment that builds trust amongst the users of ICT is an increasing priority for 
industry and governments. 

At the close of 2009, there were more than 313 million fixed Internet subscriptions in 
the OECD area - a figure that was up from just over 260 million in 2005. With multiple users 
of each of these accounts, in homes and businesses, the number of people accessing the 
Internet was, of course, much greater. By the end of 2009, nearly 91% of these subscribers 
used broadband platforms to access the Internet, thus enabling connections with higher 
performance and "always on" capabilities. This proportion is expected to increase rapidly 
over the next few years. In addition, the first high speed platforms for cellular wireless 
access have been introduced and are expected to further increase access to and use of the 
Internet. 

As ICT networks develop, the new capabilities create an increasing range of 
opportunities and challenges. The always-on connectivity enabled by broadband access, 
for example, increases the need for home and small business users to protect their 
connections with tools such as firewalls that were once only in the domain of corporate 
networks. Moreover, the higher performance of broadband means that compromised 
systems have greater capabilities to harm those of others. One example is the emergence 
of so called "botnets". This phenomenon occurs when a number of compromised machines 
act in concert, without the knowledge of their owners, to inflict harm on the connections 
of other users or to retransmit spam. A host of other threats exists and includes: 
"phishing", "pharming", "spyware", viruses, various forms of "spoofing" and "web page 
hijacking". On the other hand, broadband connections enable the ICT industry to provide 
continuously updated and improved technologies, direct to users, to prevent harm to, or 
misuse of, their systems. The automatic updates to preventative technologies such as 
firewalls and anti-virus software, that always-on connectivity facilitates, are cases in point. 
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IT security is a challenge both for Internet users and for those measuring ICT use. In 
official statistics, it is generally considered as a demand-side measurement issue and 
questions may be included in the household and business ICT use surveys undertaken by 
many OECD countries. For businesses, the usual measurement approach is to include 
questions in a survey of business ICT use or a separate IT security enquiry directed at 
businesses. For households, questions are typically added to a household ICT use survey. 

Questions on IT security usually deal with respondents' encounters with IT security 
problems, their origins or consequences, and preventative measures in place. For 
businesses, financial cost might also be asked about. Additionally, in both household and 
business surveys, IT security is often included as a response item on questions about 
barriers to e-commerce and Internet access. 

OECD governments have agreed on a number of initiatives aimed at building a culture 
of trust and security. At the international level, examples include OECD guidelines on 
security and privacy online (OECD, 2002, 2003 and 2005b). The private sector has also been 
active. Numerous initiatives have been put into place from partnerships such as the Anti- 
Phishing Working Group through to the implementation of tools that aim to build trust 
directly with users such as privacy statements, trust marks and secure servers. 

A number of questions (and parts of questions) in the model questionnaire deal with 
the important topic of trust in the online environment. The questions concern IT security 
(Questions 7 and 8), privacy and security features of a business' website (Question 16) and 
security and privacy as barriers or limitations to selling over the Internet (Question 14). 

Feedback from WPIIS delegates both confirmed the importance of this topic and the 
survey difficulties it presented. In general, the questions are relatively technical, which can 
present problems, especially for small businesses. 

At the 2005 meeting, WPIIS comments were sought on the feasibility of relatively 
untested response categories on IT security measures in place: anti-spyware software, 
regular back up of data critical to your business operations, and employee training 
programmes in IT security. The question was changed slightly as a result of feedback. 
There were suggestions from delegates that the category on anti-spyware could be 
technically difficult. The definition has been changed slightly to indicate that such 
software might be integrated into other packages. The anti-spyware and data backup 
categories remain non-core until they are better tested in member country surveys. As a 
result of comment, an item was added to the question on Spam filters (which are relevant 
for security given that spam can contain malware and cause denial-of-service). The 
concept of a spam filter was understood by respondents in question testing by Statistics 
Canada 5 and is successfully used by Statistics Denmark in its business ICT use 
questionnaire. 

Delegates were also asked for their views on the statistical feasibility of the following 
types of questions, and to offer any experience in testing or asking such questions. 

• Whether the business has conducted a risk assessment on the security of its computer 
system and, if so, what type of assessment that was (for instance, internal, by an 
external party, by a certifying organisation/authority, etc.). 

• Whether businesses that use anti-virus software download virus definitions and, if so, 
whether automatically, daily, weekly, etc. 
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• Whether the business applies patches to, or updates, software that is critical to the 
security of its computer systems, and if so, whether automatically, daily, weekly, etc. 
Feedback suggested that there are problems asking about updating of software and 
virus definitions, partly because these processes can happen automatically and therefore 
the person completing the questionnaire would not necessarily be aware of them. On the 
topic of risk assessment, question testing by Statistics Canada 5 found that the term was 
not uniformly interpreted and attracted a high "yes" response. As a result, no questions on 
these topics have been added to the model. 

There were other issues raised by member countries, the main one being that 
questions about security incidents encountered are problematic. There is significant 
anecdotal evidence that businesses will either not answer such questions or will 
understate the extent of any problems. Reflecting this concern, the question on IT security 
incidents (Question 8) was reduced to attacks by viruses, etc., and made non-core. 

Digitised products 

The Internet sales distribution question (part of Question 12) includes a percentage 
breakdown of Internet sales by product type. Of particular interest are "digitised products", 
those products that are able to be digitally delivered via the Internet. They are challenging 
statistically as they are difficult to describe in a way which is technically correct yet 
understandable to respondents. However, the United Kingdom has found that respondents 
seem to be able to provide the information in Question 12 using a very similar definition to 
that in the question. More information on the measurement of digitised products can be 
found in Chapter 7. 

E-government 

There are several issues associated with measurement of e-government (Question 19). 
There are different types of e-government surveys. The best developed statistically are 
surveys on demand for government electronic services. Eurostat has a set of questions on 
both their household and business ICT use questionnaires and most European countries 
that conduct the Eurostat surveys ask them. Some non European OECD member countries 
also ask such questions in their national surveys. 

In recognition of the statistical difficulties of the supply-side approach - collecting 
e-government information from government organisations - , WPIIS, in collaboration with 
the OECD e-Government Project, has adopted a demand-side approach to e-government 
measurement, that is, measuring the use (by businesses and individuals) of electronic 
services offered by government rather than the supply of those services by government 
entities. However, it should be noted that a demand-side approach is not without 
conceptual difficulties. 

One problem is how to define "government" on questionnaires and other survey 
instruments such that respondents (generally householders and businesses) have a 
common understanding of what is meant. The current OECD approach is to follow the 
System of National Accounts (SNA) (UNSD, 1993) that defines government units as follows 
"Government units may be described as unique kinds of legal entities established by 
political processes that have legislative, judicial or executive authority over other 
institutional units within a given area. Viewed as institutional units, the principal 
functions of government are to assume responsibility for the provision of goods and 
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services to the community or to individual households and to finance their provision out 
of taxation or other incomes; to redistribute income and wealth by means of transfers; and 
to engage in non-market production...". According to the SNA, government units can 
be "... at the level of the nation, a region or a locality". For more information, see 
http://unstats. un.org/unsd/snal993/glossform. asp? getitem=219. 

Eurostat's approach (for the questionnaire on household/individual use of ICT) is to 
use a broad scope, referring to "public authorities". 

A related problem arises from differences in the functions of government 
organisations, however defined, across countries. For instance, in one country, all rail 
transport might be a function of general government, and in another country it might be a 
responsibility of public or private sector businesses. Another example concerns 
outsourcing; government in one country might outsource a client service function, such as 
employment agency work, to the private sector while another country retains it as a 
government function. These structural differences will particularly affect international 
comparability but are also likely to affect comparability over time within a country. 

Comparison with Eurostat's model survey 

European Union countries comprise about two-thirds of OECD countries. Additionally, 
some OECD countries that are not EU members use the Eurostat model survey. It is 
therefore important to try to align the OECD and Eurostat model questionnaires (and 
associated standards) as far as possible, while taking into account the interests of the OECD 
countries that do not carry out Eurostat's model survey. The revised model questionnaire is 
reasonably consistent with Eurostat's 2006 Enterprise questionnaire - where they overlap 
(Eurostat, 2010b). However, Eurostat asks questions about several topics that are not on the 
OECD model questionnaire and vice versa, in particular, in the area of e-business. Other 
differences include instances where the questionnaires differ because response categories 
are split in one questionnaire and not in the other. The OECD model tends to have more 
response categories in equivalent questions. 

In respect of scope and classificatory variables, the revised OECD and Eurostat models 
are very similar. 

About the model questionnaire 

The revised model questionnaire, including definitions of terms and associated 
metadata notes, is shown below. 

Logic o/the revised model questionnaire 

The questionnaire logic incorporates the following main assumptions: 

• if a business does not have a computer, it is assumed that it could still use the Internet; 

• businesses that do not use any networks (internal or external) are filtered out of the 
questionnaire very early; and 

• businesses without the Internet (but with another network) are filtered out of most of 
the questionnaire and are not asked questions about IT security or questions about use 
of the Internet for business processes. This logic means that businesses without the 
Internet but on whose behalf orders are placed or received over the Internet are excluded 
from relevant questions. The general view of WPIIS delegates was that this exclusion 
would not cause a problem. 
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Core and non-core questions (and response categories) 

Questions and response categories denoted "non-core" are considered to be either 
difficult to collect or relatively untested (and therefore experimental to some degree). The 
term "non-core" is not used to indicate a lower priority. In the model questionnaire, a non- 
core question or response category is indicated by NC beside it. 

Adaptation of the model questionnaire 

It is not expected that the structure, question wording or definitions which comprise 
the model questionnaire would be used unchanged (or literally translated) in national 
surveys. However, it is important for comparability purposes that: 

• where questions are used, their meanings are preserved; and 

• the logic is preserved to the extent that the same (or very similar) populations of 
businesses are asked each question. For instance, non-computer users should be asked 
whether they used the Internet. 18 
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Notes 

1. Denmark, Finland, Iceland, Norway and Sweden. 

2. Nordic Council of Ministers: Guidelines for Measuring use of Information and Communication Technology 
(ICT) in Enterprises - a first step towards harmonised Nordic Surveys, Copenhagen 1998. 

3. World Summit on the Information Society meetings. OECD contributed to a list of core ICT 
indicators that could be used by countries following final agreement. The core indicators were 
agreed to by a WSIS meeting held in Geneva in February 2005. 

4. Model questionnaire for the Community Survey on ICT Usage and e-Commerce in Enterprises, 
2006. 

5. The testing consisted of 26 cognitive interviews with a selection of respondents from the 2004 
Statistics Canada Survey of Electronic Commerce and Technology. The work was undertaken with the 
support of WPIIS and one of its aims was to provide input to the work on revising the OECD model 
survey. 

6. This material is taken from the final model survey paper of 2005 (OECD, 2005). 

7. ISIC is the International Standard Industrial Classification of all Economic Activities. According to 
ISIC, an enterprise has "autonomy in respect of financial and investment decision-making, as well 
as authority and responsibility for allocating resources for the production of goods and services. It 
may be engaged in one or many productive activities. The enterprise is the level at which financial 
and balance sheet accounts are maintained and from which international transactions, and 
international investment position (when applicable) and the consolidated financial position can be 
derived." 

8. Defined by the European Commission as: "...the smallest combination of legal units that is an 
organisational unit producing goods or services, which benefits from a certain degree of autonomy 
in decision-making, especially for the allocation of its current resources. An enterprise carries out 
one or more activities at one or more locations. An enterprise may be a sole legal unit." 

9. Analyses done by Statistics Finland and Statistics Netherlands on the impact of different 
weighting methodologies have found that ratio estimation by turnover resulted in a higher figure 
for e-commerce value than number raised estimation. However, the difference is not thought to be 
statistically significant. 

10. These are financial and non-financial corporations following the concepts of the SNA 1993. Such 
corporations are "institutional units which are principally engaged in the production of market 
goods and non-financial services" and include corporations "subject to control by Governments". 

11. According to the SNA 1993 "The general government sector consists of the totality of institutional 
units which, in addition to fulfilling their political responsibilities and their role of economic 
regulation, produce principally non-market services (possibly goods) for individual or collective 
consumption and redistribute income and wealth". 

12. All ISIC references in this annex are to ISIC Rev. 3.1. 

13. NACE is the Statistical Classification of Economic Activities in the European Community, Rev. 1.1 
(2002). All NACE references in this annex are to NACE Rev. 1.1. 

14. In respect of Section H, Hotels and restaurants, about half the countries which do the Eurostat 
survey collect data for the remaining NACE Categories 55.3 to 55.5 (restaurants, bars, etc.). 

15. Not all countries that do the Eurostat survey collect data for all classes of Section O (Other 
community, social and personal service activities). For collection purposes, Divisions 92 and 93 are 
most relevant. 

16. Eurostat developed a specific module of the enterprise survey for a pilot study of this sector in 
2004. In 2005, the Eurostat model questionnaire was revised but limited to general ICT variables. 
For 2006, the model questionnaire was improved and included questions on e-commerce. 

17. Countries should note that the broader the scope, the larger the sample size generally required to 
obtain adequate aggregate estimates. Extending the scope to employing businesses with fewer 
than 10 employees might increase the sample size by a factor of two or more. 

18. Even though the incidence of Internet access by devices other than computers is currently low, it 
may increase with improvements in mobile phone technology (such as 3G). 
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Chapter 6 



ICT Demand by Households and 
Individuals 



This chapter describes the OECD model survey of ICT access and use by households 
and individuals. It also includes discussion of e-commerce and the social and 
economic impacts of ICT use by households and individuals. 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



Introduction 

The other major WPIIS effort on the demand side has been the development of a 
model survey for measuring ICT access and use by households and individuals. The 
impetus for such work has been a strong policy interest in issues such as equality of access 
to ICT and the potential for ICT (and, in particular, the Internet) to significantly change 
society - in both positive and negative ways. 

This chapter discusses the OECD model survey of ICT access and use by households 
and individuals, e-commerce activity undertaken by individuals, and social and economic 
impacts of ICT use by households and individuals. 

OECD model survey of ICT access and use by households and individuals 1 

In late 2002, the WPIIS finalised a model survey on ICT use in households and by 
individuals (OECD, 2002). The model survey was revised in 2005 to improve 
harmonisation with member country ICT use surveys and to reorient the surveys towards 
current areas of high policy relevance. At its 2010 meeting, WPIIS agreed to update the 
model survey of ICT access and use by households and individuals for the 2011 meeting. 
More information on the development of the model survey, as well as the model itself, 
can be found in Annex 6.A1. 

The model survey is intended to provide guidance for the collection of statistics on: 

• Household access to ICT, including broadband access to the Internet and barriers to 
Internet access. 

• Use of ICT by adults (individuals aged 16-74 years) including whether ICT was used 
during the previous 12 months, how it was used (for instance, how the Internet was 
accessed), whether security precautions were employed, where ICT was used, and what 
activities it was used for. The 2005 revision included new and revised material on IT 
security, e-government, download and purchase of digitised products, mobile Internet 
access and mobile phone use. 

Countries are encouraged to use the model as a core part of their survey development 
in this area of ICT statistics in order to improve the international comparability of 
information collected and compiled on this topic. 

Discussion of topics included in the questionnaire can be found in this Guide as 
follows: 

• Trust in the online environment (including IT security) - a special article has been 
included in Annex 5.A1. Annex 6.A1 considers the measurement challenges in this area. 

• Digitised products - in Chapter 7 and Annex 6.A1. 

• E-government - a special article can be found in Annex 5.A1. 

• Mobile phones - discussed in Annex 6.A1. 

• Use of mobile services for Internet access - discussed in Annex 6.A1. 
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E-commerce 

For individual members of households, e-commerce presents an alternative method 
of purchasing (and increasingly selling) goods and services for private use. 

We saw in Chapter 5 that it is the method by which an order is placed or received, 
rather than the payment or channel of delivery, which determines whether a 
transaction is an e-commerce transaction. OECD member countries have endorsed a 
definition of e-commerce. See Table 5.2 in Chapter 5 for guidelines on interpretation of the 
e-commerce definition. 

The statistical and policy interest for the household sector is in use of the Internet for 
such transactions, with particular interest in purchasing rather than selling transactions. 
Surveys of ICT use in households typically collect information on individual purchasing 
activity via the Internet, with details often including the nature of goods and services 
purchased, the value of those purchases, the value of online payments and/or barriers to 
purchasing over the Internet. 

The major conceptual and collection issues relating to e-commerce are described in 
Chapter 5. While most are more relevant for businesses, questions relating to the ability of 
respondents to report purchases according to the definition of e-commerce and the small 
volume of e-commerce activity have implications for household surveys as well. 

OECD countries vary in their collection efforts in this area. In particular, because of 
changes to Eurostat's model household survey (Eurostat, 2010), 2 fewer European countries 
are collecting the value of purchases over the Internet. The 2005 OECD model survey 
(in Annex 6.A1) has nominated value of purchases as a non-core question reflecting both 
the direction of Eurostat and the difficulty respondents have in recalling the value of 
purchases. In addition to purchasing activity, the model questionnaire asks individuals 
whether they have sold over the Internet, for example, using auction sites. It also asks 
about the types of products purchased over the Internet and barriers to Internet 
purchasing. 

The social and economic impacts of ICT use by households and individuals 

In contrast to the strong interest in impacts of ICT use by businesses, there has been 
little work done on impacts of use by households and individuals. However, the availability 
of ICT has obviously changed - and will continue to change - the way people work (for 
instance, teleworking), how they access commercial and government services, and what 
they do with their leisure time (for instance, the substitution of the Internet for TV). These 
changes are having, and will continue to have, impacts on society and the economy. 

In respect of social impacts of ICT use by households and individuals, the analytical 
work done has tended to be based on small-scale studies rather than more comprehensive 
exercises that use the type of official statistics we focus on in this Guide. However, it is clear 
that there are both negative and positive aspects to such use. For instance, on the negative 
side, consider the question of undesirable content accessible via the Internet and changes 
in the way people relate to each other (for example, the substitution of e-mail and SMS 
messages for personal contact). On the positive side, there are many advantages and 
conveniences offered by ICT in learning, communicating, accessing services and so on. 

An area that has received significant attention is the question of the digital divide - 
simply defined as the gap between ICT "haves" and "have-nots". However, this is not so 
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much an analysis of the impact of ICT use as an analysis of exclusion from its use. It is 
predicated on the assumption that ICT is, on balance, a positive phenomenon and that 
those without access to it are relatively disadvantaged. 

Notwithstanding that most economic analysis of the impacts of ICT has focused on 
ICT use by firms, the use of ICT by households undoubtedly has impacts on economic 
performance. 

• First, demand for ICT goods and services by households is an important component of 
overall demand, which has stimulated the growth of the ICT sector, and has helped to 
foster technological progress in ICT applications. ICT has also stimulated demand for 
products in sectors that rely heavily on ICT, for example, media and entertainment, 
leading to growth in those industries as well. 

• Second, the wide diffusion of ICT across the economy and to most households may 
enable a critical mass without which firms may not be able to achieve the full benefits of 
switching to ICT, e.g. in the delivery of their products. 

• Third, the diffusion of ICT to households may help in fostering basic abilities for ICT use 
as well as more sophisticated ICT skills, which can benefit companies that require 
experienced ICT users. 

• Fourth, use of ICT at home may enable companies to achieve greater benefits from 
teleworking, which could enable companies to rationalise their working environment. 

• Finally, increasing access to ICT by households can help reduce socio-economic 
exclusion, by providing access to information as well as more competitive prices. 

As these topics have not received as much attention from economists as the economic 
impacts of ICT use by businesses, empirical literature is somewhat limited. 

Work in the area of measurement of social impacts of ICT (as applied by, or applicable 
to, national statistical offices) is summarised in a paper prepared for the 2007 WPIIS 
meeting (OECD, 2007). 

Notes 

1. A note on terminology: the Guide uses the terms "model survey" and "model questionnaire". The 
latter refers specifically to the questionnaire provided as a model to participating countries. The 
former refers to the questionnaire plus associated information, such as recommendations on 
methodology, scope and classificatory variables. 

2. Model questionnaire for the Community Survey on ICT Usage in Households and by Individuals, 
2006. In addition, the 2007 and 2008 model questionnaires for the Community Survey do not 
address barriers to purchasing over the Internet. However, an extended module on e-commerce 
and trust was implemented as part of the 2009 model questionnaire. 
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ANNEX 6.A1 



OECD Model Survey of ICT Access 
and Use by Households and Individuals 

Introduction 

This annex is based on a number of papers presented to the WPIIS and records of 
discussion at WPIIS meetings. The main sources are the paper presented to ICCP that 
proposed the first model survey for declassification; the (slightly) revised version of that 
paper (OECD, 2002), and papers leading up to the finalisation of the revision of the model 
survey in 2005. 

As with the business questionnaire, OECD has benefited from the work of Eurostat, the 
statistical office of the European communities, and a number of member countries that 
have been prominent in this area of measurement. Many provided invaluable assistance to 
the lead country (Australia) in developing the 2002 model survey and to the OECD 
Secretariat in revising the model in 2005. At its 2010 meeting, WPIIS agreed to update the 
model survey of ICT access and use by households and individuals for the 2011 meeting. 

History of the model survey's development 

At the April 2000 and 2001 meetings of the WPIIS, Australia presented a model survey 
for ICT use by households and individuals. Discussion at the WPIIS, Voorburg Group and 
Eurostat meetings and subsequent correspondence indicated a diversity of views on the 
content of such a model survey. The 2002 WPIIS meeting discussed major outstanding 
issues and reached broad consensus. Another round of discussion following that meeting 
and subsequent written comments led to a final proposal that was presented to WPIIS' 
Parent Committee ICCP for declassification (approval) in October 2002. Slight modifications 
were made the following year. 

The 2002 proposal suggested that additional components of the questionnaire be 
added over time as technologies, usage practices and policy interests change. In discussing 
the proposal, the 2002 meeting agreed to review the inclusion of several items at the first 
review of the model survey. In particular: 

• Additional modules on use of mobile phones and e-mails. Whilst seeing value in the 
suggested modules, the WPIIS agreed that consideration should be deferred until the 
first review of the approved model survey. 

• Children's use of ICT. The WPIIS agreed to leave children's use of ICT out of the current 
proposal. It might be considered in the future, possibly in different types of survey 
vehicles, e.g. school surveys. It was pointed out that countries that wish to collect data in 
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respect of children's use of ICT are not constrained by the age limit of 16 recommended 
by the model survey. In order to achieve international comparability, those countries are 
asked to also produce output in respect of people aged 16 years and over. 

• Internet purchases by location of supplier (international versus domestic transactions). 
Based on suggestions that the question posed difficulty for respondents, it was agreed to 
defer consideration of this question until the first review of the model survey. 

The 2003 meeting considered these issues and agreed only that more development 
work should be undertaken on refining a set of mobile phone and e-mail questions for 
discussion in 2004. The meeting also agreed that more work should be done on expanding 
the existing items covering household interaction with government by electronic means. 

To accommodate these changes, the 2003 meeting agreed that the questionnaire 
should be reviewed to remove lower priority questions (or reduce them to non-core status). 

In response to the outcome of the 2003 meeting, a Secretariat proposal outlining a 
number of areas for revision was presented to the 2004 meeting. The proposal suggested a 
thorough review of the model survey to ensure that it continued to reflect current policy 
needs and priorities and was aligned, as far as possible, with country survey practices. 

A detailed proposal, developed by the Secretariat in consultation with interested 
member countries, was presented to the 2005 meeting and subsequently revised based on 
comments made at, and following, the meeting. 

The revised model was finalised in late 2005 and distributed as DSTI/ICCP/IIS(2005)3/ 
FINAL (OECD, 2005). 

Development of the revised model of 2005 

In order to prioritise material to be included in the revised model survey, content was 
examined from both an output and an input perspective. Regarding output, reference was 
made to the OECD list of core e-commerce indicators, agreed at the 2000 WPIIS meeting, 
and data that OECD has been able to collect from member countries. A core list of ICT 
indicators proposed for use by non-OECD member countries (per the WSIS 1 meetings) was 
also consulted in order to ensure as many options as possible for future benchmarking 
across a greater number of countries. 

Regarding input, survey material from a number of member countries was examined, 
including the Eurostat questionnaire for 2006 (Eurostat, 2010). Where a majority of country 
surveys had not incorporated an existing (2002) model survey question, then it was 
generally removed or revised. 

New topics were considered based on known policy needs and experiences of member 
countries with questions about those topics. An important criterion applied at each stage 
was to try to minimise the number and complexity of the questions. This is in recognition 
of the high cost of collecting these data in terms of expense and respondent load. 

Comment was sought on the 2004 proposal from all WPIIS delegates following the 
meeting. A number of countries and organisations responded. In January 2005, a revised 
questionnaire was sent out to countries and organisations that had responded earlier. 
Feedback from this round of consultation was incorporated and a detailed proposal was 
presented to the 2005 WPIIS meeting. 2 

The 2005 model survey consists of a number of elements that are described further 
below. They include: survey methodology; scope and coverage; classificatory variables; 
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particular statistical issues associated with household and individual ICT access and use 
measurement; comparison with Eurostat's model survey; 3 and a model questionnaire 
(including definitions of terms and metadata notes). 4 

Survey methodology 
Introduction 

Neither the 2005 nor the 2002 model surveys offered detailed advice on how to conduct 
or process household surveys. The aim is to convey the methodological points and 
conceptual issues that are most relevant to the collection of household and individual ICT 
access and use information. 

Additionally, for most countries, there are established procedures in place for 
household surveys that collect ICT access and use data. Therefore no recommendations 
are made on the following aspects of collection methodology: 

• For use of a particular type of sample frame, sampling methodology or sample size; 
these will vary according to country practices and the availability of information (for 
instance, administrative information on individuals). 

• Whether collections should be mandatory or voluntary - both types of collections are 
used among OECD member countries; however, where collections are voluntary, non- 
response will tend to be higher and therefore the recommendations below regarding 
survey bias will be more relevant. 

• How to process collected information, including editing, imputation and benchmarking 
of data; and 

• A particular type of survey vehicle. There is a variety of survey vehicles used by member 
countries to collect data on household and individual ICT access and use. Most countries 
use existing household surveys (such as, labour force surveys or general purpose 
household surveys). At least two OECD countries use separate collections for household 
ICT access and individual ICT use data. 

Minimising sampling and non-sampling error 

In general, countries should note that differences in survey methodologies can lead to 
inconsistencies in output. All countries should therefore aim to reduce sampling and non- 
sampling error ("bias") as much as possible by: 

• using well designed samples that are of sufficient size to produce reliable data (that is 
having low standard errors for the aggregates suggested in this paper); 

• careful design and testing of questions and question sequences; 

• intensive training and checking of interviewers, where they are used; 

• reducing the non-response rate as far as possible; and 

• minimising data entry, editing and other processing errors. 

Collection techniques 

Most member countries use personal interview techniques for collecting data on 
household and individual access and use of ICT. Personal interview can be by face-to-face 
or by telephone and, for either method, interviewers may be assisted by computers (using, 
for instance, CAPI or CATI applications respectively). Face-to-face interviewing may be 
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better for some situations in that it potentially allows the interviewer to check the type of 
Internet connection or other technical details. 

Telephone interviews should generally be avoided where it is not possible to include 
mobile phone only or unlisted subscribers. 

It is also suggested that postal surveys generally not be used because they offer less 
opportunity for interaction with the respondent (for instance, to clarify technical issues) 
and because response rates are likely to be lower, thus leading to higher sampling error and 
possible non-response bias. However, it is acknowledged that postal surveys offer 
advantages such as cost and a simpler method of presenting list-based questions (of which 
there are several in the model questionnaire). They are likely to be most reliable when used 
in conjunction with other questionnaire-based approaches such as a drop-off/call-back 
(or post back) approach that may enable some interaction and improve the response rate. 

Statistical units, selection and weighting 

Both households and individuals are recommended as statistical units. Information 
should ideally be sought from a randomly selected adult (some-one aged between 16 and 
74 years) who responds in respect of the household (Section A of the model questionnaire) 
and in respect of him/herself (Section B). Alternatively, more than one household member 
could provide individual information in Section B. Households, and individuals within 
households, should be selected in an unbiased manner. 

Because the sample of households and individuals selected is unlikely to be perfectly 
representative of the whole population, it is important to weight responses according to an 
independent estimated distribution of the population. 

Survey frequency and reference period/date 

It is probably unrealistic to expect participating countries to conduct surveys more 
frequently than annually. For some participating countries, an annual collection will not be 
feasible, in which case it is important that those countries align their collection years as far 
as possible. 

As some of the information collected is point-in-time data, it would be preferable to 
also have alignment of reference dates across participating countries. However, the 
dependence of many countries on existing survey vehicles probably makes this an 
unrealistic expectation. 

Scope and coverage 
Individuals 

The scope of individuals would normally be limited by age. The 2002 OECD model 
survey recommended that all individuals aged 16 years or over be included in the scope of 
the survey. However, many European countries have an age range of 16-74 years and 
therefore exclude individuals aged outside this range. In the 2005 revision, the lower age of 
16 years was retained but an upper age limit of 74 years was introduced, giving a common 
individual age scope of 16-74 years. 5 This is consistent with Eurostat's recommendations 
and OECD data collection practices. Of course, individual countries can choose to collect 
data from individuals aged outside the 16-74 years range and are encouraged to do so 
(of particular policy interest for many countries is the use of ICT by those aged 75 and over). 
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Other scope or coverage limitations on individuals are likely to be relatively minor and 
could include things like limiting the survey to those living in private dwellings (therefore 
excluding individuals in institutions such as prisons and nursing homes and special 
dwellings such as hotels); excluding full-time members of the armed forces; and excluding 
non-residents and some foreign residents. Such limitations are likely to have a fairly small 
impact on estimates so no recommendations are made here. 

Households 

It is recommended that household scope be consistent with that for individuals, 
therefore households where all members are outside the age scope, will themselves be out 
of scope. This is a change from the 2002 model where all households were in scope. 
However, many countries are constrained by use of existing survey vehicles and are not 
able to follow that guidance. A number of European countries, for instance, exclude 
households consisting only of members over 74 (or, less likely, under 16). 

Many countries will also restrict household survey scope or coverage to those in 
private dwellings. For some countries, there could be other reasons for a more limited 
scope (or coverage) of the national survey. They include exclusion or undercoverage of 
particular households, for example those in remote or inaccessible areas. 

For both households and individuals, it is important that countries advise of 
significant impact on survey estimates resulting from deviations from scope, or areas of 
poor coverage. 

Classificatory variables 

The 2002 OECD model survey recommended inclusion of minimal information on a 
number of household and individual characteristics. A similar set of classificatory 
variables is included in the 2005 model survey, though many countries will decide to use 
extra variables and/or additional categories. Data for these variables will usually be 
collected as part of the survey (though note that questions have not been included in the 
model questionnaire). Of possible interest to those countries where a rural/urban divide 
exists is a geographical classification. However, such a variable is problematic from an 
international comparability viewpoint and has not been included in the model. 

Household characteristics 

The 2002 OECD model had a household size (number of members) variable and a small 
household composition classification that identified several different household types 
(e.g. couple, one parent family, lone person). The composition variable in the 2002 model 
survey did not have an equivalent in the Eurostat model. Eurostat's current approach is to 
collect information on the total number of household members as well as the number of 
children under 16 in the household. The Eurostat approach enables tabulation of 
households by size and type (those with and without children under 16). For simplicity and 
improved comparability, it was adopted in the 2005 model, leading to household variables 
as follows: 

• Household type (two-way classification: households with/without children under 16); and 

• Household size (number of members including those outside the age scope). 

The variable, household income is differently defined in the 2002 OECD and Eurostat 
model questionnaires. The 2002 OECD model specified annual gross household income 
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from all sources, while Eurostat defines the variable as average net monthly household 
income. Household income is not collected on all countries' household ICT access and use 
surveys and for this reason is an optional variable on the Eurostat model. Nevertheless, it 
is regarded as an important classificatory variable because of the strong correlation 
between household income and access to ICT. Regarding the conceptual basis of the 
household income variable, a quartile approach has been adopted by Eurostat from 2006. This 
approach entails either collecting income in ranges corresponding to quartiles (based on 
other survey data) or collecting income data in other ways and converting it to quartiles for 
output purposes. 

Given that countries that collect household income as a classificatory variable use a 
variety of bases (monthly, annual, gross, net, etc.), the quartile approach allows better 
comparability. The revised OECD model therefore does not make any recommendation on 
the conceptual basis of household income but asks countries that collect it to either collect 
or output household income on a quartile basis for the purposes of classifying household 
ICT data. 

Individual characteristics 

Age is a strong determinant of ICT use so a common age cut-off is important. 
Consistent with the age scope, an age range of 16-74 is recommended. It is also 
recommended that the following sub-ranges be used as output categories of the age 
variable: 16 to 24; 25 to 34; 35 to 44; 45 to 54; 55 to 64 and 65 to 74. These are the ranges used 
by OECD and Eurostat for their model surveys but they differ from the 2002 OECD model 
that had coarser categories. 

The 2002 model included a variable, highest education level received, with four categories: 
primary, secondary, post-secondary (not tertiary) and tertiary. For consistency with 
Eurostat, the classification has been reduced, giving a three-way classification as follows: 
No formal education, primary or lower secondary (ISCED 0, 1, 2); Upper secondary and post- 
secondary non-tertiary (ISCED 3, 4) and Tertiary (ISCED 5, 6). 6 

In respect of employment status, for consistency with Eurostat, the first two categories 
in the 2002 model (full-time employee and part-time employee) have been combined giving 
the following four-way classification: paid employee; self-employed; 7 unemployed and not in the 
labour force. 3 ' 9 

The other two individual characteristics in the 2002 model were Gender and Occupation. 
They are retained in the revised model. In respect of Occupation, countries are asked to use 
ISC088 major groups where possible (as in the 2002 model). 

In terms of output, many countries may wish to cross-classify some of these variables. 
This can produce information that is very useful for analytical purposes. However, it 
should be noted that cross-classified output is often more detailed and therefore usually 
requires higher sample sizes to support reliable estimates. 

Particular statistical issues associated with household/individual ICT access 
and use measurement 

Households versus individuals as statistical units 

A key issue concerns the appropriate statistical unit for measurement. In general, the 
household unit is used to elicit information about facilities in place in the household 
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(for example, whether there is a computer or Internet access). The individual unit is used 
to provide information on use of these facilities (both in and away from the home) and, 
most importantly, the intensity of that use (for instance, frequency and range of activities 
undertaken). Debate continues among OECD countries on the preferable unit, though at 
this stage most use both. 

Recall period 

Amongst OECD countries, this has been a much-debated issue, though mainly in the 
context of the value of Internet purchases by individuals. 

The 2002 OECD model questionnaire used a 12-month recall period for all questions 
except for the value of Internet purchases. The 2006, 2007 and 2008 Eurostat model 
questionnaires ask questions in respect of both 12 months and three months (for instance, 
individual use of a computer and the Internet, and whether the individual has purchased 
products over the Internet) but ask others (e.g. location and frequency of use, and activities 
undertaken) in respect of the last three months. 

The 2005 OECD model retained a 12-month recall period for individual use questions 
but includes new filter questions probing the time period when activities occurred (use of 
a computer, the Internet and purchasing). This allows tabulation of those aggregates for 
both three- and 12-month time periods. An additional point regarding recall period, is that 
for EU and probably most other OECD countries, in respect of main aggregates, it makes 
little practical difference whether a three- or 12-month period is used (as very few 
individuals are infrequent users). The most obvious exception to this is the value of 
Internet purchases (see discussion below). 

The advantages of a 12-month recall period include avoidance of seasonal effects and 
better capture of less frequent activities such as selling on line, dealing with government 
organisations or searching for health information. 

In respect of the value of Internet purchases, countries should select a recall period for 
Internet purchases that would enable calculation of 12 months' value. For instance, 
countries that collect monthly information should collect information in respect of the last 
month; countries collecting quarterly data, in respect of the last quarter, etc. Whichever 
method is chosen, it should be able to deliver a reasonably unbiased estimate of the value 
of Internet purchases in respect of the 12-month reference period. 

Trust in the online environment 

Several questions (and parts of questions) in the model questionnaire deal with the 
topic of trust in the online environment. The questions concern the issue of IT security 
(Questions 8, 15 and 16) and privacy, security or trust as barriers (Questions 5 and 23). 

WPIIS comments were sought on the feasibility of the new Questions 15 and 16, and 
on including several other trust topics as follows: 

• Whether households/individuals who use anti-virus software download virus 
definitions and, if so, whether this is done automatically, daily, weekly, etc. 

• Whether households/individuals who use the Internet apply patches or software 
updates that are critical to the security of their computer, and if so, whether this is done 
automatically, daily, weekly, etc. 
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• Whether individuals regularly back up their important files, e.g. documents, spreadsheets, 
e-mails, digital photos. 

• Which sources individuals use to find information about IT security issues (e.g. newspapers, 
TV, vendor websites, government websites, etc.). 

General feedback from Eurostat and others is that it is problematic asking individuals 
about IT security in terms of: the incidents they have encountered, what action they take 
to protect themselves and whether the computer they use at home is protected. Feedback 
on the inclusion of the new topics outlined above was couched in similar terms, that is, 
respondents are unlikely to be able to respond to such technical questions. The only 
exception appears to be whether individuals regularly back up important files. This is a 
question successfully asked by Finland and a new non-core question (Question 8) on this 
topic has consequently been included on the model questionnaire. 

While the general feedback on IT security questions was sceptical, they are of such 
policy importance that they have been retained as non-core questions. One change made 
as a result of feedback is to limit Questions 8 (on data backup) and 15 (on incidents 
experienced) to home use only as this is the environment about which users are likely to 
know most and over which they have most control (for instance, they may have no role in 
backing up material at work, nor knowledge about attacks on the computer they use at 
school). 

More information on this topic can be found in Annex 5.A1. 

Internet access using mobile services 

The questionnaire includes a question (Question 11) on individual mobile access to the 
Internet. The question focuses on mobile services unlike a similar question on the Eurostat 
2006 questionnaire that asks about devices used for mobile access. The OECD approach is 
thought to be better aligned with policy interests in this area and is slightly simpler. The 
question is non-core because it is both untested and possibly technically complex for some 
respondents. 

Digitised products 

The Internet activities and purchasing items questions (19 and 21 respectively) contain 
several new categories designed to probe individuals' interest in new types of products that 
the Internet has made possible. These so-called "digitised products" are those that are able to 
be digitally delivered via the Internet. They are challenging statistically as they are difficult to 
describe in a way that is technically correct yet understandable to respondents. 

The value of Internet purchases 

The 2002 question on the value of Internet purchases has been included in the revised 
questionnaire with few changes (Question 22). However, it is a conceptually complex 
question and has been made non-core because of difficulty respondents have answering it 
accurately. Importantly, Eurostat has dropped this question from its model questionnaire 
(from 2005). 

Mobile phones 

In OECD countries, information on mobile phones has conventionally been collected 
in respect of the household (therefore whether the household, through one or more of its 
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members, has access to a mobile phone). However, there is increasing recognition that it is 
more important to examine individual use of mobile phones, especially since they are 
typically owned and/or used by an individual rather than a group of people. The model 
questionnaire includes two questions (24 and 25) on individual mobile phone use. It should 
be noted that the questions are relatively untested in OECD countries and therefore might 
change as experience increases. They have been denoted non-core for this reason. 

E-government 

Issues associated with measurement of e-government (Question 19) are described in 
Annex 5.A1. 

Comparison with Eurostat's model survey 

European Union countries comprise about two thirds of OECD countries. Additionally, 
some OECD countries that are not EU members use the Eurostat model (Eurostat, 2010). It 
is therefore important to try to align the two model questionnaires (and associated 
standards) as far as possible, while taking into account the interests of the OECD countries 
that do not carry out Eurostat's model survey The revised model questionnaire is 
reasonably consistent with Eurostat's 2006 Household questionnaire - where they overlap. 
However, Eurostat asks questions about a number of topics that are not on the OECD model 
questionnaire and (to a lesser extent) uice uersa. Other differences include instances where 
the questionnaires differ because response categories are split in one questionnaire and 
not in the other. Such differences may be able to be dealt with at the output stage. 

For differences in the recall periods used, see Recall period above. 

In respect of scope and classificatory variables, there were a number of differences 
between the 2002 OECD and Eurostat models most of which have now been removed, 
leaving the 2005 OECD and 2006 Eurostat models very similar. 

About the model questionnaire 

Core and non-core questions 

Questions denoted "non-core" are considered to be either relatively untested and 
therefore somewhat experimental, or difficult to collect. The term "non-core" is not used 
to indicate a lower priority. In the model questionnaire, a non-core question is indicated by 
NC under the question number. 

Format of the model questionnaire 

The OECD model questionnaire is not an operational questionnaire that can be used 
directly in countries' household surveys. This is because countries conduct household ICT 
access and use surveys in different ways, each requiring their own types of survey 
instruments. For instance, a questionnaire that is self-enumerated will look quite different 
from one designed for a telephone survey, which in turn will differ from a questionnaire 
that is used for face-to-face interviewing. Because the model questionnaire is not an 
operational questionnaire, it does not show: 

• questions that establish the values of classificatory variables (household and individual 
characteristics); 

• filter questions that have no ICT data content (e.g. whether the respondent is an 
employee); 
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• interview instructions (though it does indicate question populations and logic); and 

• how questions are asked (this will vary depending on the collection methodology used, 
for instance, personal interviewers might use prompt cards for a number of the "list" 
questions whereas telephone interviewers might use a running prompt i.e. ask each 
response item as a yes/no question). 

Adaptation of the model questionnaire 

It is not expected that the structure, question wording or definitions that comprise the 
model questionnaire would be used unchanged (or literally translated) in national surveys. 
However, it is important for comparability purposes that: 

• where questions are used, their meanings are preserved; and 

• the logic is preserved to the extent that the same (or very similar) populations of 
households or individuals are asked each question. 



126 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



> I 



e/3 F 

£ I 

CD » 

o w 

o .2 



ra £ "5 ^ <u 



C/3 "O (D 



3 



-— ~Q t/} CD 



T3 O ■*— 



E ^ 



U_ O <£ Ll_ 



E £ « £ 



E 
o 

s 



= 11 = 

S » ? £ 

e 3 ^ = 

» o C13 <U 

^ w is E 



3 <£ 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



127 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



=5 * 



== E 







-S3 




o 


T3 


TO 


03 


s 


s alk 




nse 




o 

Q. 

C/l 


or no 


iple re 


lethei 


Mult 














TO 












tfra 








(/> 

CO 




CD 
Cj 




Cj 
TO 




O 
















o 




CD 

» 




O 

■c: 




CD 




■SCO/ 





E -S 



128 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



— 



E S 



C2_ W U3 



E 5 



i— CM 



□ 



= 3 



E *= 



I - 
e a 

s 5 
= 3 

= -D 
g. > 
= 1 



E ~ 

CM 15 



E " S. S 
° » E S 

E O "S3 



5 = * & 



E "= ° 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



129 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



O ^ 



E =C 



O S 



E 



Cm 



E _g 



to *~ 



— o 



= e £ 



E § 



130 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



.e <t 



.■^ O ZJ 



"0 ~ >^ Q. 

03 03 

w E >- 

Cm 1 — l 



ii n 

8 * f & 
8 E o. s 

= £- "TO q - 
as o *- = 
g a J.9 



E ^ B 

- CD fc 



1i « „ « 

c re re o <u 

C — Cj 



£ E 
re re 



=3 ts 



re .5 
E 

M « 

© J2 



en l ~ 



o ™ — 



*■ qj *- re _ 



to a;, 



V U 

I* 
II 



S 



9- S 



3 Q- 



E g 



2 -S "a 



E S 
£ E 



u • » 
= — !S 
o - o 

■S S E 

SIS 



to to ,w c/3 



V *= •— ° 



3 E 5 
"o 2 *S 

CO 5 CO 



5 g 

I I 

o O 

CO CO 



u a u 



E - 



JO 



ESS 



s- S 
8 oj 



u 5 *= 



& 6 



* 5. -S 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



131 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



CD OJ CD to 



s ~ 

re ^ 



o ±r 



132 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 




OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



E 

a 



5 1 

E E 



"5 ^ "S 



E £2 



134 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 




OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



C 
o 



if) 
o 
o 

CM 



CB 
3 
T3 

.5 
c 

• 1-4 

T3 
C 

CB 

w 

'o 
js 

(U 
VI 

3 
O 

V) 

3 

T3 
C 

cs 

w 
w 

<U 

u 
u 

cs 

E- 
U 



2! 
n 
c 
c 
o 

•43 
ifl 
0) 
3 
<T 

% 
T3 
O 

s 

Q 
U 
u 
O 



< 

CD 

1 



oo go 

s .= 

CD O 

5^ CO 

-a ZJ 



o. p 



E 
Si 



C3 = 



□ S S 



to C\j 
•5 ^ 

.. V, 

-a 



3 . 

o" 43 



2 6 



c 



to tu 

* 3 



to o, » 3 

to tu 3 jtj 



5 S 

■S | 

O M 

t! S 

0J o 



to cu 

2 o. 
S B 

_ o 

to u 

3 to 



.2 



to tu oj O 
Si -° <u 

XS 4^ 



■a a 2 

4-. 3 

o 

to 43 



T3 £ 5 ,2 



G 



c 2 
o c 
0 m 



43 



P. — 2 

oT DO 3 

Si .5 c 



tO *w 

3 



c S 



3 c 

oi qj 

*j £ 

S g 

oj o 

> U 

is tu 

w -5 

tu +- 1 

'C o 

o ^ 

DO cd 

OJ a; 

u £ 



2 a ■a 



■5 A 



u ■S Z 



£ E 



g 

■43 a c 

to OJ 

OJ xf > 

3 OJ OJ 

a- C t3 

3 3 .S 

P 2 S 



5 s. 

U QJ 



T3 U 

l-H O 

S 2 



O 43 
DO F_, 



u Oj 



5 .5 

XI 4-. 

13 O 

to C 

aj" .2 

43 to 

« .2 



5 c 



to a; 
J3 3 



d to 



o to 
a; .y 



aj tu 
S ^ 



2 .a 

43 P. 



CO 



3 

u. P. 

tu u 



a 
u 



§ 6 

° 8 

u u 

tu £ 

§ g 

cn 

O DO 

P-. 2 

tO 

oj ii. 



O ^ CO 

OJ U T3 

to 

O 



OJ ~ 



CO 33 ^ 

tj v 



P3 
3 

oj g 
to u 



3 X! 
O C 
43 CO 



to S u o a 



E a 



03 



■a u ^ 
as ° 

oj « >, 
god 

C DO ^ 

£ .5 2 

i3 10 6 

a J 5 

.2 a a 

5 OJ 4p 
CO v 

> « o 

fY oj 2P 
5 -° -S 

3 xl "a 
8 3 S 

CO r£3 

■S (U g 
IA h gi 

CJ 73 



> ^ 
nJ ID 

6.SS 
p. oocg 

oj 42 co 

43 O O 

+J rn J-h 

■u B 43 

o u * 

OJ oj 

^ 43 

S o 

DO 3 

3 

^ 3 



43 43 

c 6 

S o 

•a s «! h =3 



&. QJ 
P J2 



■a * 

o S 



p. g 



42 3 

u cr 

° r- 

c -6 

> UD 

CJ 

OJ OJ 

DO g 

OJ Dh 

+3 CO 

CO OJ 

u C 
6, 

C £ 

co o 

£ B 

XI 4^ 

CO 4^ 

5 c 

tu ? 

6 43 

s f 

O 43 

O ^ 

OJ 

,o > 



E B S 



a, xs 



43 

^ CO 



O OJ 

C ,o* 



to 



nS oi 
T3 4-; 

T3 O 



id & 7^ 

4^ Si 



01 

■S o « 

o * £ 

do ^ m 

QJ tf] 

cd C oi 

u C .U 



oi ^ 

O) ^ 
X CO 



OJ nJ 4_, -m O o 



6 2 



jU cd M OJ 

cc co PQ cr 



136 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



O ^ <U 0J 

■*-> <d jz; co 

CO 01 ^ 



CD -r-. £ UJ 

M B S O 3 

5 JH £ 5- 



,2 >, „ s p, 

^ ■a « ™ 



> >> 0) <J o 



B ■£ 

CD CD 

■S 6 



CO CJJ 
QJ J- 

CT DO 

c 



QJ 



to 



s a 



5 c c 



tfi ns 

CO *" O 

T3 ^ u 

j. « <u 

T« C3 W 



a r 

cC cO 

; £ | 

u co 

■S ° 

73 1-. 

g Ji 



c " 



c -a ft 



3? e 

S. o 
do u QJ at 



o £ 

- i 8 

5 E B 

.5 ,S 



« ^ s j 



co 75 cd 



cd 

oo « 

g .5 

S tu 



co r 
£ aj 

c 6 



c .. . 

OJ X> « 

■° 3 O 



■a » 

co 1 



-G „ 



■3 co <y 



G xi 
& C 
co 



CO CD* 



73 £ 

"3 ° 



cd 



in 



^ *-> w 

D* R -5 

R OJ ■ M cn ' 

£ £ 2 & 

co Qj cd p., ■ 



Sow 



qj aj 

- c U 



g ^ * 

^ y) 4_i 



aj co o +j 



cu oo 



do J±J 

° 2 xi 



P. s S? ra « 2 



5 o 



c - 

P r: cJ 
>h *C? rc 



CO 



c 

T3 



B «s -a 



m DO 

? 5 .5 J2 

J2 ^- CO 
m O- 10 Xl 

g 13 T! P- 

u «.S « 



G 3 



I B 



CO xi 
OJ ^ 
3 S 



3 



co « £ 



3 

a 



T3 
C 



* Q..S — 



CO ~ 



■=1 P 



2 J 



id a; 



2 



^ c 6 



XI 



So S ^ s 

co 'rl ^ 

*^ co +- 1 

a; a co t3 



OJ 



CO OJ 



5 -S « -9 

(1J ^ ^ fli 



^ n3 
cd cj 

'3 



U3 CC 



R QJ 

CO X) 



co M 
3 



o +J 

3 6 

C o 

CD X. 



CO 

3 CU 

« c 
■3 o 
&. 



~Z S B 



3 -S 



c 

o x 

"to a 

3 S 

& ° 

CO 



~ 3 

CO *J 
-3 E 



z z 



CO 



S 3 

,s ° 



■a. * 



J3< 3 



C 

- CD 
S 13 



a u 
*T 3 



CO CD 
in -3 
O *1 



co Lo 
CO CD 



3 
cr 



(I *• » 



3 a 



S ^ 3 

DO u 



P. >s 
CD CO 



O T3 

Cfl 

1 s 
I g 



OJ r o 



u ^ 



cr cd 
i- c 



^ _co 

Z H 



3 6 ffi 



co iX 

CD _ 

3 co 

ccr u 



G 

JG 



3 3 



CD CD 

6 6 



3- 

co C 

CD O 



3 o 

CD T3 
XS 3 



XI 

5 



Sg 'fi S 3 g 

^3 C -° 

3 oj to 5 

C O > co CO 

•§ u a -a ^ 

co Si -S 3. S 



?5 » 

^ 3 

5 S .2 

S 3 e 



& co ^ 



3 



■a P s 



3 CD >i 

S « 3 3 

E i- cr ra 

E ^ g 

o co a 

U CD CO cO 



G CD r 
CD do 

B x . 



c 

XI 



c 

CD CD 

■5 B 

4-. QJ 



>i CO 

s P [ 
H co 



CD co 

s I 

CO CD 



3 o 



CD CO p — i *4j 



CO DO 
CO 

CD ? 



T3 

C 
3 



G 

O 



r-X U 4-. O 

3 - a m 

O rG CO CD 

_c; c) ^_ +-* 



1.1 

CN x! 



« " c > 10 01 

3 CO CD « J 

"CI £ h o ° 

£ * g ^T? XI 

O CO 3 ?J CD XI 

3 S nf ■£ 3 ra 



ft- be 1 s 
*~t »1 1 



£ Oh qj cd 



T3 T3 
C R 
CO * a iJ 



I i3 

M to 

CO CO 

O _U 

co S 

& 3 



1 1 



.2 ft 1 
cs S 



2 f 3 



3 .a 
cr pc 

3 & 



■ fl CO 



& g CO 
CD - H 
3 .2 O 



■a 6 6 a » g 

tfl 9 n CO CD CO 

■p Pj« iS 'P u co 

H .5 H co ex 



CU QJ 



fu o ^ u 



CO T3 

aiG 

H S 



CO CD 

DO XI 

3 tl 

3 CO 

co X! 



G 
O 

3- £ 
CO CO 



CO 



G 
o CG 

DO S 

3 „ 
■ XI 

o ra 
U CO 

y xi 

< ^ 



X! 



S s - 



o 

G 

S .2 G 



!D XI 



O DO o JG 3 
o G ? °- 



co 3 
3 73 



xi 
c 



" G 
& O 
G 

G 



J G 
co 3 



CO " C 

G CD CD 

O Xj o 

•a 2 i 

G co co 

CO ft* 

DO U co 

o e j 

7J S CO. 



CD 



G 

73 CO 



G B 

C CO 

O DO 

DO 



■e 71 c 

2 

CO rG 



P. ^ 



il 

H 

CO CD xi 

2- ■£ 3 

S . co 



G 
] D 

(U 



CO ^ 

. o ^ 
M > 

a" 5 

CO .ti 
3 P 3 



G P- ' 



rC 



C! QJ 



OJ > S 

O ^ oi 



ftSjs 

73 3 cs. 



"S -3 



6 6 

a c 

C & 



co 3 o », 



J3 
3 



o "Sr 

CJ co 



O C 

CO CD 



a J3 sp oj a 



*j G ■ 

3 ,2 

CD ^ft 

- G 'co 

S G P. • 



u O ft ft. 



CD O 

§ .a 
"I 

■rH CO 

1 2 3 

™ co 

U 73 

— c 

5 10 
c 

G 'to 

CD CO 

tl JG 

i- ft 



lti ti) 



co oi o 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



137 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



■fi > P 

O O 4J 

00 ^ Tj 

cu rd J? 

oj .a 2 



c u o 
a S « 



.2 a 



2 u .2 co 

* § 1 - 

r: do c ' H 

5 3 " T) 
O C 



U rC 5 
OJ ' 4-1 

r=" m CO 



'co C 

CO CU 



DO 



3 DO 



CO CO 

™ &' 

■a a • 

c s 

ID 3 

4_, O 

a " 



Oh 



3 Ql CU 01 

o rt X % 

W > 3 

■ h ni 

4-J >H tO 

3 a b! 

> do o oj 

n c 73 

O ^ M C 

H xi rj — ■ 

O £ .S 1h 

^ 8 M .o 

W CJ X) Cd 

tJ ro OJ g 



o b ^ 

a DO OJ qj 

g cb - 2 

** U CO -fn 



qj 
> 

0) & 



o 'S » 

XS --j T3 

'do ^ .5 

£ if 5 ' M 

„ i — i CO C 

c O O 

.2 oj § u 

S s 5 a 



E2 3 ^ 

5 _r o 



cu 'cd xi 

w > cd 

co cd £ 

> 2 u 

CO M 



^ s y 

C QJ (C 

.2 .-2 .2 

o oj ^ 

O cu en 

c * J2 

< S u 



s a 



c c to 



co CO 



J3 & 

o w 

n 3 

CD o 

cn it- 
cO ^ 

!-i CU 
2 



.2 3 

to >i 

p 3 



1 I* 



■3" — <= •£ 



— • rl Q 



o a s 



OJ CCJ 
■- S J3 

g £ B 

Q -a qj 
. a 2 £ 



.5 "£s 

cd ^ 



[2 - 



CO 

c 

3 C 



0) .fc 

CO 

10 

o £ 



pi, tl M 

'3 «- *> 

. qj cd 

a £ B 

5 o yi 

Oh U gj 



.5 oo ' ■ rl 



o £ c 

£ TT 1 o 

■u a c 

X cj CO 

cu 3 e 

| E 



6 s 
S « 



> cu 
g c 

O 



3 ° CI 

o jn cd 

^5 a u 

3 .a OJ 



3 i 



o £ 



E 5 

.& a 
cs< 



4J o >. cu 

g sis 

cd ■ — 

s 7r 

cu A a ^ 



to t! = 



o 2 



cJ^. 3 



c 
2 ^ 



eg .3 ^ 



B u 

tn m 

cd t-j 

^3 G fli 

S3 g § 

OJ . QJ 

■D o m 

3 -2 8 

ti t; n 

C O 

o p. C 

u a. <h 

cj C 

& CO el 

6 



cu o C o 



S o 



fx jj cu 
. u w 
^ (U o 

S B-8 



o y 



a; 



to 



C T3 

i a 

c >- 

oj s 



G co cu 

lw !>. P< 
« JJ o 



QJ cu CO 

JJ b « 



c 

8 t3 2 

■8 u c 

« 2 .2 

CO 3 cj 

QJ O QJ 

Mis 

DO CO o 

3 C U 

tO ^ r 

„ 2 f- 

D V U 

CJ CO —* 

w p 

c-> H 



4J 0 

u Z 



CO 



QJ ,JVI 
4^ co 
CO 



QJ O — QJ .2 



>, CO C 



2 

■ti £ c 
o JS. o 



qj 3 c 

3,5 « 



P. g. 



y] 2 
2 6 



C tu o 

QJ r^J CO 

cu 2 



■« c2 3 



^ cd 

^ 5 S 

§ & 2 g 
S P. a R 



C u QJ 
B £ > 

> 2 

^ ss a 

SEE 



3 s ^ ^ 

■Si, & 2 o 



to at . . 

— i U 3 
C h3 



CD 3 



~ tf B 



U C QJ 

S c° B 

QJ 



Ctl 

c 

cu 



^ ■« P 

o p m £ 



ca 

Qj 



2? r o 

£ £ X 

!2 C cd 

. C o _ 

cd g C 

.2 a -s 

■° f? * 

C4-. O QJ 

° c = 

5.2 8 



O 

XJ o 



- 1 s 



^ CO 
0 CO T3 



2 

s 



s is 



cd xi 



,cd nj" 



c < o 
s «« 



oj o 



cm <y "S c 

H t C O 

o, S5 ^ c 

" o « « 

£ cu ^ oj 

a S ^ « 

r- U -5 

^ CJ C 

QJ J-H g 

■5 CU O 

U C 

" 3 e 

S "2 « 

■M r m 

cd M 43 

« if ! 



S3 « S <S 0 



QJ U O 

, « J2 



«l 7~" CO ~— CO CO 3-d! 

4^E- , unJcu>yiT3 



C co O 
■2^3 

ffl 5 0 

u 

C " c 

c2 * 10 

c -o .5 

,ri OJ _ 

CU 4H 13 

J-4 CO QJ 

o a ti 

6 6 5 



cu Xi 



CP " 
0) 



cd 



E 

o * -C 
c° w " 

QJ cu 
QJ -B K 
O cg 

2 

QJ 



CO U 



9i <u 
c S 



ca 



d) C/l 



CU 



QJ 



^3 &0 



o 
d u 

CL) 2 
m - 

5 § 



•p 2 

J-4 ^* 

CO c 



QJ 



c 

q 



5 a; 
2 3 



138 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



6. ICT DEMAND BY HOUSEHOLDS AND INDIVIDUALS 



References 

Eurostat (2010), Model ICT use questionnaires, years 2002-2010, Eurostat, Luxembourg, http:// 
circa. europa.eu/Public/irc/dsis/em is annexes/libra ry?I=/data_-_database/theme_3_-_popuI/isoc/ 
householdsindiu&um=detailed&sb=Title. 

OECD (2002), "Measuring ICT Usage and Electronic Commerce in Households/by Individuals. A Model 
Questionnaire", Working Party on Indicators for the Information Society, DSTI/ICCP/IIS(2002)1/ 
REV2, OECD, Paris, www.oecd.org/dataoecd/3f3/20630152.pdf. 

OECD (2005), "ICT Use by Households and Individuals: Proposal for Revising the OECD Model Survey", 
Working Party on Indicators for the Information Society, DSTI/ICCP/IIS(2005)3/FINAL, OECD, Paris, 
u; uw.oecd.org/dataoecd/58/27/35937246.pd/. 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



139 



Copyrighled material 



OECD Guide to Measuring the Information Society 2011 
© OECD 2011 



Chapter 7 



Content and Media 



This chapter describes statistical issues relating to information and electronic content 
and more recent work on the definition of content and media sector and its products. 
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Introduction 

The introduction to this Guide states that "we live in a period of unprecedented 
technological change, both in terms of the extent and speed of change (...) Many of the 
underlying transformations are undoubtedly associated with the set of interrelated and, 
more recently, converging technologies that have come to be known as ICT." 

In an attempt to describe and understand the magnitude of these changes, 
considerable effort has been made to measure the supply and use of ICT. However, 
relatively little is known statistically about the many developments that result from the 
flow of information, or so-called "content", which is enabled by ICT. 

Yet those developments are increasingly significant. For instance, business models are 
being re-invented, particularly in industries whose output is information in one form or 
another (for instance, news, music, film, scientific information and business information) 
and industries whose processes rely heavily on information processing and exchange 
(financial services and education, for example). 

A range of industrial, labour, trade, cultural and intellectual property policy issues are 
emerging as a result of better communications and information exchanges. These policy 
issues are often embodied in the somewhat vague notions of digital content and digital 
delivery. 

The first challenge for the statistical system is to develop the definitions and 
measurement models necessary to describe the extent of those changes and so inform the 
relevant policy debates. It is clear that the many issues at stake cannot be addressed with 
a single measurement model. It is also clear that existing industry, product and demand- 
based models have limits. 

This chapter outlines conceptual work done on the topic by the WPIIS and describes 
current measurement approaches by the WPIIS and ICCP. 

Because the topic is complex, terminology is an important aid to understanding. 
A note on terms used is therefore likely to be helpful. For the purposes of this Guide, the 
terms commonly used in discussing the topic have meanings as follows: 

• The "content and media sector" consists of industries that are engaged in the production, 
publishing and/or the electronic distribution of content products (OECD, 2006a). 1 

• "Content and media products" are mainly produced by businesses that are classified to 
the industries that comprise the "content and media sector". However, some content 
and media products will be produced by businesses outside the sector and by other 
sectors of the economy, including government, as secondary activities. 

• The "electronic content sector" (or "digital content sector") consists of industries that 
primarily produce "electronic content products" (or "digital content products"). For most 
firms and most industries, electronic content products are still a minor output. This view 
is reflected in the structure of ISIC Rev. 4, which does not separately identify electronic 
content activities (industries). 
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• The terms "digitised product" and "digital delivery" are linked. A digitised product has 
been defined as a product that can be delivered on line. 

It is clear from the discussion above that there is an industry view of content and a 
product view. Analogous to the approach taken with the ICT sector and ICT products, 
classifications are needed to describe content industries and products. Also as with ICT, 
such classifications would preferably be based on existing classifications such as the ISIC 
and the CPC. 

Revisions made to this chapter in 2009 mainly reflect the development of a "Content 
and media sector" definition by WPIIS (OECD, 2006b) and a "Content and media products" 
classification (OECD, 2008). 

The Content and media sector definition 

In 2006, WPIIS started work on revisions to the ICT sector and ICT product definitions 
to conform with to the revised ISIC (Rev. 4) and CPC (Ver. 2). At the same time, the Working 
Party started developing a definition of a "content and media" sector based on the premise 
that "Content and media industries are engaged in the production, publishing and/or the 
electronic distribution of content products" (OECD, 2006a). 2 The Working Party agreed that 
the sector would consist of industries of Division J of ISIC (Information and 
communication) except for those that are already included in the ICT sector definition. 

A history of WPIIS deliberations on the "content" sector can be found in Annex 7.A1 - 
as can the definition of the agreed Content and media sector (released in 2007). 

The Content and media product classification 

Following agreement on a Content and media sector, the development of a product 
classification became possible. The work was undertaken by the WPIIS Classifications 
Expert Group and the following guiding principle was used to identify Content and media 
products (it was adapted from the definition used to determine the Content and media 
sector): 

"Content corresponds to an organised message intended for human beings published in 
mass communication media and related media activities. The value of such a product to 
the consumer does not lie in its tangible qualities but in its information, educational, 
cultural or entertainment content." 

The main features of the Content and media product classification, in terms of its 
relationship with both the sectoral definition and the ICT product classification, can be 
summarised as follows (OECD, 2008): 

• all of the products of the Content and media sector are included in the product 
classification; 

• four products of the ICT sector are included in the Content and media products list. They 
are the three games software products and Web search portal content; and 

• four products that are not products of the Content and media (nor ICT) sector are 
included in the classification based on majority support from the expert group and 
consistency arguments (see Annex 2.A1 for details). 

The list was agreed 3 at the end of 2008 (and slightly revised in January 2009 following 
further minor changes to the CPC at the end of 2008). There are 74 Content and media 
products in the list and six broad level categories as shown in Table 7.1 below. The detailed 
list can be found in Annex 2.A1. 
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Table 7.1. Broad level categories for content and media products 

Broad level categories Number of CPC subclasses (products) 

Printed and other text-based content on physical media, and related services 18 

Motion picture, video, television and radio content, and related services 24 

Music content and related services 5 

Games software 3 

On-line content and related services 12 

Other content and related services 12 

Total 74 



Digitised products 

In 2005, the OECD distinguished digitised products and broadly defined them in an 
attempt to develop demand-side questions on their use, sale and purchase. 
According to this definition, digitised products include both: 

• products (such as reports, movies, music and software) which can be delivered over the 
Internet in digitised form and have a physical analogue (such as a CD or DVD). For such 
products, the analogy with the physically delivered product is direct (e.g. a downloaded 
movie file and a DVD of that movie, an MP3 file and a CD); and 

• other digitised products where the analogy with a physical product is less direct, for 
instance, new kinds of web-based products that are accessed on line. They include 
online news, information or financial services and online games (where the nature of the 
game is different from other computer or video games because of the networking 
capacity of the Internet). 

While a variety of services can be digitally delivered and are therefore included above, 
others may be ordered over the Internet but largely delivered or provided offline. Examples 
of such transactions include buying insurance through an Internet broker, reserving a hotel 
room through a hotel chain's web-based reservation system, booking plane tickets through 
an airline's website and ordering concert tickets from an online seller. 

Modifications to the OECD model survey on ICT use by businesses 

A new question on the nature of products sold over the Internet was added to the 2005 
model questionnaire (see Annex 5.A1, Question 12). The question distinguishes: 

• physical products - those ordered on line and delivered off line. They include raw 
materials, components, stationery, hardware, books and CD-ROMs; 

• digitised products - are either delivered over the Internet in digitised form, replacing 
physical products e.g. reports, software (in lieu of paper or CD versions) or are new kinds 
of web products which are accessed on line and substitute for physical products, e.g. 
online financial and information services; and 

• offline services - are ordered on line but are delivered, or substantially delivered, offline. 
They include bookings for accommodation, travel and events. 

Modifications to the OECD model survey of ICT access and use by households 
and individuals 

In order to obtain measures of demand for digitised products, extra categories on 
Internet activities and products purchased over the Internet were added to the relevant 
questions in the 2005 model questionnaire. The new Internet activity items include extra 
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categories enabling the identification of digitised products that also exist in physical form 
(for instance, movies or music). New items included for purchased products distinguish the 
product in digital and physical form. For instance, computer software is split into computer 
software that is physically delivered (e.g. as a CD) and computer software that is digitally 
delivered (downloaded from the Internet). A significant advantage of including questions 
in the model survey is that information on activities and purchases can be broken down by 
characteristics of the individuals concerned, for instance, by their age, gender and 
education level. 

A sectoral study approach to measuring digital content 

It is clear that digital content - and digital delivery of content - are increasing in 
significance, driven by enhanced technological capabilities, a rapid uptake of broadband 
technologies and improved performance of hardware and software. Digital content and 
associated applications offer new business opportunities and potentially improved access 
to knowledge and research. Digital content can also be a major driver of ICT industries 
such as telecommunications. 

The OECD's Committee for Information, Computer and Communications Policy (ICCP) 
has been looking at digital content issues in the emergence of new network-based services 
since 1996. 4 More recently, their focus has shifted to work on broadband content and digital 
delivery of goods and services (OECD, 2004). 

At its March 2003 meeting, the ICCP Committee held discussions on interlinked 
broadband and digital content developments and policy issues. The Committee adopted 
two tracks for this work, agreeing to work towards a Committee statement on promoting 
broadband development and to develop a work proposal on digital content. At its October 
2003 meeting, it was agreed that the ICCP Committee should undertake more 
comprehensive analysis on digital content, focusing on growth and value creation, drivers 
and barriers to growth, and changing market structures and emerging issues. 

In early 2004, following its preparation in the ICCP Committee, the OECD adopted the 
Recommendation of the Council on Broadband Development (see Box 7.2 below), setting out ten 
recommendations for OECD member countries when establishing or reviewing their 
broadband policies. These policy recommendations recognise the increased policy 
attention towards broadband content and applications. The ICCP Committee has been 
asked to monitor the development of broadband in the context of this Recommendation - 
this process took place during 2007 and 2008. 

At its April 2004 meeting, the ICCP Committee agreed to the work plan on digital 
broadband content, with this work being undertaken in the Working Party on the 
Information Economy (WPIE). The WPIE has completed an initial set of stocktaking studies 
of the following sectors where digital content is transforming business models: scientific 
publishing, music, online computer and video games, mobile content services and user- 
created content. Work is ongoing on film and video, online advertising and news 
distribution. The studies were designed to further identify analytical, policy and 
measurement issues, and to prepare the ground for more in-depth analysis of horizontal 
issues and challenges to broadband content development and applications. A major OECD 
international conference on the Future Digital Economy: Digital Content Creation, 
Distribution and Access was held on 30-31 January 2006 in Rome. 5 
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At the request of the WPIE, a content policy framework was developed in 2006. 
Business and public policy issues to be addressed are grouped in six areas as outlined in 
Box 7.1 below. 



Box 7.1. Digital content policy framework 

i) innovation and technology (e.g. enhancing R&D and innovation in content, networks, 
software and new technologies); 

ii) value chain and business model issues (e.g. developing a competitive, non- 
discriminatory business environment); 

iiijenhancing the infrastructure (e.g. technology for digital content delivery, standards and 
interoperability); 

iu)business and regulatory environments that balance the interests of suppliers and users, 
in areas such as the protection of intellectual property rights and digital rights 
management without disadvantaging innovative e-business models; 

u) governments as producers and users of content (e.g. commercial re-use and pricing of 
public sector information); and 

ui) conceptualisation, classification and measurement issues. 

Source: OECD "Digital Broadband Content Strategies and Policies", u;u™.oecd.org/dataoecd/54/36/36854975.pdj r . 



In 2006, the WPIE agreed that the existing digital content policy framework could be 
further developed in key areas of importance for the development, distribution and use of 
digital content. 

In parallel, the OECD is working on increasing access to public sector information 
(e.g. geographical and meteorological data, information held in libraries, archives, 
museums). The public sector is a large producer of content with major potential for 
digitisation and new commercial and non-commercial applications. Wider availability and 
use of public sector information and content can arguably contribute to economic growth 
and enhanced citizen welfare. A study has been completed on access to public sector 
content (including the commercial re-use of public sector information). Follow up work 
includes refinement of the analysis, and potentially the development of international 
principles and guidelines. 

For more information on this work, see: www.oecd.org/sti/digitalcontent for the work 
on digital content and ujiuiu.oecd.org/Futurelnternet for the 2008 Ministerial on "The Future 
of the Internet Economy". 
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Box 7.2. OECD Recommendation of the Council on Broadband Development, 2004 

The OECD Council recommends that, in establishing or reviewing their policies to assist 
the development of broadband markets, promote efficient and innovative supply 
arrangements and encourage effective use of broadband services, Member countries 
should implement: 

• Effective competition and continued liberalisation in infrastructure, network services 
and applications in the face of convergence across different technological platforms that 
supply broadband services and maintain transparent, non-discriminatory market 
policies. 

• Policies that encourage investment in new technological infrastructure, content and 
applications in order to ensure wide take-up. 

• Technologically neutral policy and regulation among competing and developing 
technologies to encourage interoperability, innovation and expand choice, taking into 
consideration that convergence of platforms and services requires the reassessment 
and consistency of regulatory frameworks. 

• Recognition of the primary role of the private sector in the expansion of coverage and 
the use of broadband, with complementary government initiatives that take care not to 
distort the market. 

• A culture of security to enhance trust in the use of ICT by business and consumers, 
effective enforcement of privacy and consumer protection, and more generally, 
strengthened cross-border co-operation between all stakeholders to reach these goals. 

• Both supply-based approaches to encourage infrastructure, content, and service 
provision and demand-based approaches, such as demand aggregation in sparsely 
populated areas, as a virtuous cycle to promote take-up and effective use of broadband 
services. 

• Policies that promote access on fair terms and at competitive prices to all communities, 
irrespective of location, in order to realise the full benefits of broadband services. 

• Assessment of the market-driven availability and diffusion of broadband services in 
order to determine whether government initiatives are appropriate and how they 
should be structured. 

• Regulatory frameworks that balance the interests of suppliers and users, in areas such 
as the protection of intellectual property rights, and digital rights management without 
disadvantaging innovative e-business models. 

• Encouragement of research and development in the field of ICT for the development of 
broadband and enhancement of its economic, social and cultural effectiveness. 

The Council also instructs the Committee for Information, Computer and 
Communications Policy to monitor the development of broadband in the context of this 
Recommendation within three years of its adoption and regularly thereafter. 

Source: OECD, Recommendation o/the Council on Broadband Development, C(2003)259/FINAL, luiuuj.oecd.org/dataoecd/ 
31/38/29892925.pdf. 
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Notes 

1. From 2006, the sector was called the "content and media sector" but references earlier than that 
are referred to as "content" in this chapter. 

2. The development work was undertaken by the WPIIS Classifications Expert Group (established to 
make recommendations on information economy classifications to the broader membership). 

3. Declassified by the WPIIS parent committee, the Committee for Information, Computer and 
Communications Policy (ICCP). 

4. See OECD (1998) and (1999). 

5. See www.oecd.org/sti/digitalcontent/conference. 
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ANNEX 7.A1 

OECD Definitions of the Information Economy 

Sectors 

Introduction 

This annex is based on summary records of, and papers presented to, the WPIIS and 
its predecessor, the Ad hoc Meeting on Indicators for the Information Society (under the 
aegis of the ICCP Statistical Panel). The annex firstly provides a brief history of OECD and 
member country work on the ICT sector definition including: deliberations leading to its 
agreement, the original (1998), revised (2002) and current (2007) definitions of the sector 
and some practical notes on data collection. Secondly, it provides a discussion of 
deliberations on a "content" sector, leading to agreement on a definition of a Content and 
media sector in 2007. 

Importantly, the information economy sector includes the industries in both the ICT 
and the Content and media sectors. 

The United Nation Statistics Division (UNSD) agreed to integrate the OECD's 
information economy sector definitions into the 2007 ISIC as an alternative aggregate. This 
presented an opportunity to encourage the use of these standards outside the boundaries 
of the OECD, a goal supported by the Committee for Information, Computer and 
Communication Policy (ICCP) and in line with the outreach strategy embraced at the World 
Summits on the Information Society (2003 and 2005). 

The ICT sector definition 
History 

While a definition of the ICT sector had been considered by the OECD before 1997, we 
start this history with the first meeting of the precursor to the WPIIS in 1997. The ad hoc 
Meeting on Indicators for the Information Society took place in June 1997, with a major 
agenda item being consideration of a definition for the ICT sector. A paper on the topic was 
presented by Canada who informed the meeting of the definition adopted by Canada, 
based on the Standard Industrial Classification (SIC). The classification consisted of 
relevant industry classes in Manufacturing and Services. 

The reaction of the meeting was positive, especially in relation to the manufacturing 
industries in the definition. In relation to services, there was some debate over whether the 
definition should be expanded to include electronic content producing industries. 
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Measurement of the ICT sector was again a major focus for the 1998 ad hoc Meeting on 
Indicators for the Information Society. A paper from Australia proposed a definition of the 
ICT sector and explored issues such as specialisation ratio (the proportion of businesses in 
an industry that have ICT activity), the fact that ICT products will also be produced by 
enterprises that are not classified to ICT sector industries, and the overlap of the ICT sector 
with content industries. This was illustrated by the figure reproduced below. 



Figure 7.A1.1. Overlap between the information technology, telecommunications 
and information content activities of firms (adapted from a Finnish model) 




Source : OECD, DSTI/EAS. 



In referring to Figure 7.A1.1, the paper proposed that "Conceptually ... the ICT sector 
can be viewed as the activities which fall into the union of the Information Technology and 
Telecommunications activities in the diagram above. It includes therefore the intersections 
between them and the Information Content activities. However it excludes those 
Information Content activities which fall outside those intersections; that is, those which 
have no direct ICT association." 

The Australian paper proposed a set of information industries that could be included 
by countries wishing to incorporate content-producing industries. The paper also proposed 
part industries for inclusion in the ICT sector. 

Following discussion of this paper plus other contributions from Australia, the Nordic 
countries and the European Commission's Task Force on Information Society Statistics, the 
meeting agreed "to pursue a two-stage approach to developing an industry definition. In 
the first phase the focus would be on industries and then, in the second phase, a product- 
based definition would be used to further refine the industry definition at a later date. It 
was also agreed that to reach agreement a pragmatic, step-by-step approach would need to 
be adopted where initially an industry definition for ICT would be pursued and then, once 
achieved, a broader definition of the "information economy" would be developed that 
included not only ICT but also content industries." In relation to the inclusion of part 
classes, it was decided, for pragmatic reasons, that "no parts of classes would be included 
in the definition." In respect of guiding principles that describe ICT industries, principles 
proposed by the United Kingdom were discussed and modified. 
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Agreement was fairly readily reached on inclusion of the following ISIC Rev. 3 
industries: 

• 30 Manufacture of office, accounting and computing machinery. 

• 32 Manufacture of radio, television and communication equipment and apparatus. 

• 3312 Manufacture of instruments and appliances for measuring, checking, testing, 
navigating and other purposes, except industrial process control equipment. 

• 3313 Manufacture of industrial process control equipment. 

• 6420 Telecommunications. 

• 7123 Renting of office machinery and equipment (including computers); and 

• 72 Computer and related activities. 

Other industries attracted more debate as follows: 

• ISIC 3130 Manufacture of insulated luire and cable was questioned because of its inclusion 
of transmission cable for electric power. However, because of the perceived growing 
importance of optic fibre cables, it was agreed to include this industry with the 
understanding that there would have to be a footnote on historical time series alerting 
users that because of technological change and the advent of optic fibres the nature of 
this industry had changed significantly over time. 

• After a lengthy discussion, it was agreed to exclude ISIC 9213 Radio and Teleuision 
Activities. However, where transmission of radio and television programmes was done as 
part of the work of a business classified to ISIC 9213, the transmission activities would be 
included. In those cases, it should be included with a footnote attached to 6420 
indicating that the activity of this industry is classified to 9213. 

• It was agreed that the definition of the ICT sector would not include content industries 
but that future work would focus on industries that would be added to an industry 
definition of ICT to form a definition for the information economy. 

• In the case of ISIC 5150 Wholesale o/machinery, equipment and supplies, ISIC Rev. 3 does not 
have sufficient subcategories to allow a differentiation between ICT equipment 
wholesaling and the wholesaling of other equipment (e.g. industrial machinery). To avoid 
this problem, delegates agreed to include 5150 but to report data only for the relevant ICT 
wholesaling activity by using more detailed national classifications (e.g. NACE 5143, 5164 
and 5165). The more narrow national classifications used would be noted in a footnote. 

• In relation to retailing, because very few retailers exclusively sell ICT products, it was 
agreed to postpone the inclusion of 5233 Retail sale of household appliances, articles and 
equipment until a goods definition was available. 

An agreed definition (1998) 

With the conclusion of the discussion at the 1998 Ad hoc Meeting on Indicators for the 
Information Society, an industry definition of ICT was established as shown in Box 7.A1.1 
below. The definition was subsequently agreed and declassified by the parent body, the 
ICCP Committee. 
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Box 7.A1.1. Agreed definition of the ICT sector, 1998 
(based on ISIC Rev. 3) 

The list of industries below was approved by delegates attending the Second Ad Hoc 
Meeting of Indicators for the Information Society under the aegis of the ICCP Statistical 
Panel. 

The definition is a compromise, limited to those industries which facilitate, by electronic 
means, the processing, transmission and display of information, and it excludes the 
industries which create the information, the so-called "content" industries. The definition 
permits the immediate gathering of statistics for international comparison in an area of 
considerable policy importance because of deregulation and technological change. The 
statistics and their comparison will contribute to the work of the next stage of the Panel 
which is the development of a similar list of content industries and a classification of 
products which belong to the information and communication technology (ICT) sector. 

On the basis of this decision, it was further decided that the definition being proposed 
would not include any "parts" of industries but would rather include the entire industry 
even though in some cases the latter might not be strictly an ICT activity. Exceptions to this 
general rule, could be considered whenever it was felt, by the majority of countries, that 
the complete exclusion of an industry would mean the exclusion of a significant number 
of businesses which are producing ICT goods and services. A set of principles was adopted 
that would provide a conceptual basis to the selection of industries chosen as "ICT". 

For manufacturing industries, the products of a candidate industry must: be intended to 
fulfil the function of information processing and communication, including transmission 
and display; or use electronic processing to detect, measure and/or record physical 
phenomena, or to control a physical process. Components primarily intended for use in 
such products are also included. 

For service industries, the products of a candidate industry must be intended to enable 
the function of information processing and communication by electronic means. 

In the view of the members of the Panel, the "information economy" consists of the 
economic activities of those industries that produce content, and of the ICT industries that 
move and display the content. These economic activities include the use of information 
and of ICT products by both people and business. The "information society" includes the 
social impact of the information economy. These "working definitions" were seen as a 
means to promote discussion of the definitions of the constituent parts and of their 
boundaries. They could not be seen as final until agreement had been reached on the 
parts. The next steps in building indicators for the information society is agreement on a 
definition of the content industries which, when added to the ICT definition, will provide 
a working definition of the information economy. At the same time, the Panel will develop 
a classification of ICT products which will permit the gathering of statistics on the ICT 
output of industries not included in the definition. 

The proposed definition of ICT includes the following ISIC Rev. 3 industries: 
Manufacturing 

3000 Manufacture of office, accounting and computing machinery 
3130 Manufacture of insulated wire and cable 

3210 Manufacture of electronic valves and tubes and other electronic components 

3220 Manufacture of television and radio transmitters and apparatus for line telephony 
and line telegraphy 
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Box 7.A1.1. Agreed definition of the ICT sector, 1998 
(based on ISIC Rev. 3) (cont.) 

3230 Manufacture of television and radio receivers, sound or video recording or 
reproducing apparatus, and associated goods 

3312 Manufacture of instruments and appliances for measuring, checking, testing, 
navigating and other purposes, except industrial process control equipment 

3313 Manufacture of industrial process control equipment 
Services - goods related 

5150 Wholesale of machinery, equipment and supplies 1 

7123 Renting of office machinery and equipment (including computers) 

Services - intangible 

6420 Telecommunications 2 

7200 Computer and related activities 

1. Countries were asked to include only those sub-sectors that directly provide ICT wholesaling services. 

2. Where countries include telecommunication activities as part of radio and television activities (ISIC 9213), 
radio and television activities (9213) should be included in this definition. 



A revised definition (2002) 

Review papers were presented to the 2001 and 2002 meetings of the WPIIS. The 2002 
paper was very detailed and built on findings reported in the 2001 paper. 

The 2002 paper considered country experiences on specialisation ratios for industries 
in the ICT sector. Industries found to have low ratios were: Renting of office machinery and 
equipment (including computers), Manufacture of insulated wire and cable and Manufacture of 
industrial process control equipment. However, a sensitivity analysis of indicators of the two 
ICT manufacturing industries showed that the inclusion or the exclusion of those classes 
from the definition does not make a large difference. 

The 2002 meeting discussed revisions to the definition but agreed only to a refinement 
of ICT wholesaling that became possible because of changes in the 2002 revision of ISIC (to 
Rev. 3.1). The split followed the acceptance of an OECD Secretariat proposal put to the 
United Nations Technical Subgroup (TSG) of the Expert Group on Economic and Social 
Classifications and resulted in three classifications replacing the old class 5150. Two of 
those new classifications defined the wholesaling of ICT products, as follows: 

• ISIC 5151 Wholesale of computers, computer peripheral equipment and software. 

• ISIC 5152 Wholesale of electronic and telecommunications parts and equipment. 

Following the changes to wholesale described above, the definition changed as shown 
below. 

A complete revision (2006-07) 1 

The year 2006 was an opportune time for a review of the ICT sector. Not only were ICT 
product classifications agreed (goods in 2003 and services in 2006), but the 2007 revision of 
the ISIC (to Rev. 4) was effectively completed by March 2006, when the structures were 
approved by the United Nations Statistical Commission (UNSC). 

The OECD was an active participant in the ISIC revision process and the revised 
classification incorporated improvements to ICT industry classes. 
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Box 7.A1.3. The 2002 OECD ICT sector definition 
(based on ISIC Rev. 3.1) 

ICT Manufacturing 

- 3000 Manufacture of office, accounting and computing machinery 

- 3130 Manufacture of insulated wire and cable 

- 3210 Manufacture of electronic valves and tubes and other electronic components 

- 3220 Manufacture of television and radio transmitters and apparatus for line telephony 

and line telegraphy 

- 3230 Manufacture of television and radio receivers, sound or video recording or 

reproducing apparatus, and associated goods 

- 3312 Manufacture of instruments and appliances for measuring, checking, testing, 

navigating and other purposes, except industrial process control equipment 

- 3313 Manufacture of industrial process control equipment 
ICT Services 

- 5151 Wholesale of computers, computer peripheral equipment and software 

- 5152 Wholesale of electronic and telecommunications parts and equipment 
-6420 Telecommunications 

- 7123 Renting of office machinery and equipment (including computers) 

- 72 Computer and related activities 



Proposals for the revision of the ICT sector definition (and for a new "content and 
media" sector definition) were presented to the May 2006 meeting of the WPIIS. While the 
Working Party was not in a position to finalise the proposals, it agreed on a process to fast 
track an outcome. Delegates were given a month to send in their suggestions and a group 
of volunteer experts was given the mandate to resolve any outstanding issues and finalise 
proposals. 

The expert group was chaired by Canada and the members were: Australia, Denmark, 
Finland, France, New Zealand, South Korea, Switzerland, the United States and the OECD. 
In its deliberations, the group considered comments received from WPIIS delegates and 
Eurostat following the May 2006 meeting. Eurostat submitted its conclusion based on 
deliberations of its Working Group on ICT sector statistics and on a wide consultation of 
European countries. In total, 28 member countries provided input. 

There was no immediate consensus on the list of industries that define the ICT sector. 
The delegations that replied directly to the OECD supported a narrower list of industries, 
but the proposed scope varied from one delegation to the next. The majority of European 
countries preferred a broader definition, but again the scope varied somewhat by country. 

The debate concerned the suitability of the conceptual basis for the definition, the so- 
called guiding principles, and the interpretation of these principles. 

In the case of goods producing industries, the most basic questions were: 

• Should the scope of the definition be limited to industries producing products intended 
to fulfil the functions of information processing and communication or should the 
definition include industries producing products that use electronic processing to 
detect, measure, record or control a physical process? 
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• If a choice was made for the broader approach, how could the scope of the definition be 
justified given that more and more products incorporate technologies that use electronic 
processing? 

In the case of services producing industries, the debate concerned the interpretation 
of the guideline more than the guideline itself. The existing guideline reads "The products 
of a candidate industry must be intended to enable the function of information processing 
and communication by electronic means". The determination of what constitutes an 
"enabling" service or technology represented the main challenge. 

In addition to conceptual issues, participants in the consultation process raised a 
number of pragmatic concerns including time series continuity, the clarity of messages to 
users, and the availability and confidentiality of relevant statistics. 

WPIIS delegates, Eurostat and the UNSD all agreed to accept the conclusions of the 
expert group. Members of the expert group settled on an approach to choose among a 
number of options that emerged during the consultation phase. 

ICT manufacturing industries 

The starting point for the expert group's discussion was the proposal presented to the 
2006 WPIIS meeting and comments that followed. There was broad support for the 
inclusion of the following industries of ISIC Rev. 4: 



Group 


Class 


Title 


261 


2610 


Manufacture of electronic components" 


262 


2620 


Manufacture of computers and peripheral equipment 


263 


2630 


Manufacture of communication equipment 


264 


2640 


Manufacture of consumer electronics 


268 


2680 


Manufacture of magnetic and optical media 



* In a later version of ISIC Rev. 4, the title changed to Manufacture of electronic components and boards. 



... and the exclusion of the following industry: 



266 2660 Manufacture of irradiation, electromedical and 

electrotherapeutic equipment 



The most fundamental issue discussed was that of industry 2651 - Manufacture of 
measuring, testing, navigating and control equipment (see the discussion above). Similar 
industries 2 were included in the 2002 definition because they produce goods that "use 
electronic processing to detect, measure and/or record physical phenomena or to control a 
physical process". 

The debate centred on how to rationalise the inclusion of this industry while 
excluding others that also use electronic processing to perform some detection, recording 
or process control. A prevailing argument was that it would become increasingly difficult 
to distinguish industries that do so in a significant way from those that do so in an 
incidental way, given that ICTs are embedded into a growing number of products produced 
by a variety of industries. 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



155 



7. CONTENT AND MEDIA 



The contrary view was that the exclusion of industry 2651 represented a significant 
departure from the existing definition, one that could be difficult to explain to users and 
that would change the message given by statistical indicators. 

The expert group was ultimately swayed by the first argument and chose to exclude 
this industry from the definition. By doing so, it changed the guiding principle agreed to in 
1998. The revised guiding principle excludes the second element and is: 

"For manufacturing industries, the products of a candidate industry must primarily be 
intended to fulfil the function of information processing and communication by 
electronic means including transmission and display." 

In taking its decision, the expert group noted that ISIC Rev. 4 significantly restructured 
some of the industries of ISIC Rev. 3.1 (3312 and 3313 in particular) that are included in the 
ICT sector definition. The restructuring would make it very difficult to produce consistent 
time series when ISIC Rev. 4 is implemented. In that context, the argument for maintaining 
time series continuity is not as strong as it may appear. The group also noted that the 
narrower definition will lead to a clearer message, and therefore more useful analysis. 

There was also a debate concerning the inclusion of ISIC 2731 - Manufacture of fibre 
optic cable. Those in favour of including this industry in the definition claimed that fibre 
optic cables are an integral part of telecommunication networks. Others argued that while 
cables do transport information in electronic format, they are passive components that do 
not fulfil any electronic processing of information. This functionality is made possible by 
network equipment. Furthermore, some participants expressed concern about the 
availability of statistics for this industry, and others about the existence of such an 
industry. 

The case was presented that if a choice was made to include manufacturers of fibre 
optic cable in the ICT sector, it should also include manufacturers of other electronic and 
electric wires and cables (ISIC 2732) for two reasons: these products perform the same or a 
similar function and the producers of cable often produce more than one type. 

The expert group accepted the arguments to exclude ISIC 2731 from the ICT sector 
definition. 

ICT repair industries 

The proposal submitted for discussion to the 2006 meeting included the following 
industries: 



Group 


Class 


Title 


951 


9511 


Repair of computers and peripheral equipment 




9512 


Repair of communication equipment 


952 


9521 


Repair of consumer electronics 


331 


3313 


Repair of electronic and optical equipment 



There was broad support for the inclusion of relevant repair activities in the ICT sector. 
Repair is seen as an activity that enables the function of information processing and 
communication by electronic means. However, many expressed concerns about the 
availability of statistics for these industries, especially those subsumed within industry 
groups (3-digit categories). For that reason, there was more reluctance for the inclusion of 
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ISIC 9521 - Repair of consumer electronics (one of several industries within industry 
group 952 - Repair of personal and household goods). There was also little support for the 
inclusion of ISIC 3313 - Repair of electronic and optical equipment, especially given that 
optical equipment manufacturing is excluded from ICT manufacturing industries. 

The options that emerged for the expert group to consider were: 

• Option 1 - Industries 9511 and 9512. 

• Option 2 - Industries outlined in option 1 plus 9521. 

Although the repair of consumer electronics should logically be included in an ICT 
repair aggregate (consumer electronics manufacturing is included), the expert group noted 
the concern of many countries regarding data availability and chose Option 1, which 
excluded that industry from the ICT sector. 



ICT trade industries 

The proposal submitted to the 2006 meeting included the following industries: 



Group 


Class 


Title 


465 


4651 


Wholesale of computers, computer peripheral equipment and software 




4652 


Wholesale of electronic and telecommunications equipment and parts 




4659 


Wholesale of other machinery and equipment 


474 


4741 


Retail sale of computers, peripheral units, software and telecomm. equipment in special stores 




4742 


Retail sale of audio and video equipment in specialized stores 



There was broad support for the inclusion of relevant wholesale industries in the 
definition. The rationale for including ICT wholesale in the current definition is that 
organisations manufacturing ICTs in some OECD countries are often distributors of ICTs in 
other countries. The argument was that a business such as IBM should be included in the 
ICT sector in all countries, irrespective of the relative importance of its various ICT related 
activities (manufacturing, software development, IT infrastructure service or IT distribution 
services). This argument explains the continued support for the inclusion of wholesale 
activities. There was, however, little support for the inclusion of class 4659, which was seen 
as too broadly defined to be a useful component of the definition. 

There is no similar argument for ICT retail industries, nor the same level of support for 
the inclusion of retail activities in the ICT sector. Those who argue for inclusion generally 
do so for the purpose of consistency. Those against inclusion tend to argue that specialty 
stores' low share of the total ICT retail market means that statistics are incomplete and 
therefore somewhat misleading. 

The options that emerged for the expert group to consider were: 

• Option 1 - Industries 4651 and 4652 

• Option 2 - Industries outlined in option 1 plus 4741 

• Option 3 - Industries outlined in option 2 plus 4742 

The expert group accepted the arguments to exclude specialty retail activities from 
the ICT sector definition and chose the first option. 
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ICT services industries 

The proposal submitted to the 2006 meeting included the following industries: 



Group 


Class 


Title 


582 


5820 


Software publishing 


601 


6010 


Radio broadcasting 


602 


6021 


Television broadcasting 




6022 


Cable, satellite and other subscription programming 


611 


6110 


Wired telecommunications activities 


612 


6120 


Wireless telecommunications activities 


613 


6130 


Satellite telecommunications activities 


619 


6190 


Other telecommunications activities 


620* 


6201 


Computer programming activities 




6202 


Information technology consultancy activities and computer facilities management activities 




6209 


Other information technology service activities 


631 


6311 


Data processing, hosting and related activities 




6312 


Web portals 



* Some titles in this group changed in a later draft of ISIC Rev. 4. 



The inclusion of telecommunications (Division 61), computer programming activities 
(industry group 620) and information service activities (industry Group 631) was not 
questioned. It was accepted that the products of those industries are intended to enable 
the function of information processing and communication by electronic means. 

The discussion focused on software publishing and broadcasting industries, in 
particular whether these industries should be classified to the ICT services grouping or to 
a proposed Content and media sector. 

On different occasions during the ISIC and CPC revision consultation processes, WPIIS 
and some national delegations made the point that software publishing (ISIC 5820) 
comprises at least two distinct components - the publishing of productivity software and 
the publishing of multimedia software. Ideally the publishing of multimedia software 
would be classified to the Content and media sector. This type of software is designed to 
inform, educate or entertain. It has more in common with other types of "content" products 
such as newspapers, television programmes, films or musical recordings. Productivity 
software on the other hand is designed to facilitate information processing and seems more 
appropriately classified with technology-centric services such as telecommunications or 
hosting services. 

However, at this point in time, the option to make that distinction is not available 
because ISIC recognises only one software publishing industry that produces both types of 
software. Given this constraint, the expert group recommended the inclusion of this 
industry in ICT services. 

The discussion on broadcasting was essentially about its defining characteristic. 
Broadcasting results from a set of activities including the development of channels and 
programming (scheduling, commissioning and production) and the transmission of those 
programs. Those activities are sometimes vertically integrated. The transmission aspect of 
broadcasting clearly enables the processing and communication of information, like other 
activities classified in the ICT services grouping. The development and programming 
aspects of broadcasting are of a very different nature and have more in common with those 
of other content industries such as publishing or film production. 
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The expert group and the majority of delegations were of the opinion that the 
development of channels and programming is the defining characteristic of establishments 
classified in ISIC Division 60, Programming and broadcasting activities. This Division was 
therefore assigned to the Content and media sector. 

The changing nature of broadcasting, in particular the transmission aspect of 
broadcasting, and the potential impact of these changes on industry classification was also 
discussed. The case of IPTV 3 in particular was brought up. The incidental classification of 
IPTV in ICT services is coherent with the principle of the proposed classification since it is 
essentially a transmission activity. The same observation applies to mobile TV, another 
new mode of broadcasting. 

However new modes of broadcasting are at an early stage of development. The clear 
distinction seen today between the transmission activity and the content development 
activity may well blur in the future, and establishments classified in other industries could 
join the IPTV market. If and when these changes materialise, it will be important for 
statisticians to develop the tools (including classifications) to track the phenomenon. 



Box 7.A1.2. The 2006-07 OECD ICT sector definition 
(based on ISIC Rev. 4)* 

ICT manufacturing industries 

- 2610 Manufacture of electronic components and boards 

- 2620 Manufacture of computers and peripheral equipment 

- 2630 Manufacture of communication equipment 

- 2640 Manufacture of consumer electronics 

- 2680 Manufacture of magnetic and optical media 
ICT trade industries 

- 4651 Wholesale of computers, computer peripheral equipment and software 

- 4652 Wholesale of electronic and telecommunications equipment and parts 
ICT services industries 

- 5820 Software publishing 

- 6110 Wired telecommunications activities 

- 6120 Wireless telecommunications activities 

- 6130 Satellite telecommunications activities 

- 6190 Other telecommunications activities 

- 6201 Computer programming activities 

- 6202 Computer consultancy and computer facilities management activities 

- 6209 Other information technology and computer service activities 

- 6311 Data processing, hosting and related activities 

- 6312 Web portals 

- 9511 Repair of computers and peripheral equipment 

- 9512 Repair of communication equipment 

* From OECD (2006a). The codes and titles were checked against the final (November 2008) version of ISIC 
Rev. 4. 
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Variables for collection of ICT sector statistics 

The specification of information to be collected about the ICT sector and the 
consequent definition of variables was not a consideration of the WPIIS. However, it has 
arisen as a practical matter as data on the subject have been compiled by the OECD. 

In its early data collection work on the ICT sector, the OECD collected information on, and 
defined, the following variables: Capital expenditure, Employment, Number of enterprises, 
Production, Research and development, Value added, Wages and salaries, Business sector 
value added and Business sector employment. For those interested, the definitions are 
available from the OECD publication Measuring the ICT Sector (OECD, 2000). 

More recently, OECD is accepting definitions of those variables that are compatible 
with countries' National Accounts tables. 

As part of a change to its approach to collection of ICT sector data, OECD is reviewing 
the definition of the total business sector. As the ICT sector is an activity-based definition, 
a total business sector defined by activities may be preferable as a denominator, rather 
than a total business sector defined on an institutional basis. 

Potential collection difficulties for the ICT sector 

Some participating countries have encountered the following problems in applying 
the 2002 OECD ICT sector definition: 

• For countries that do not use ISIC Rev. 3.1 (or NACE Rev. 1) to classify economic units, 
there may be some correspondence issues that need to be addressed. 

• For confidentiality reasons, some countries may be unable to report data for 
telecommunications services. Aggregation into total ICT services (which is the level at 
which OECD generally tabulates ICT sector data) will often solve this problem. 

The first dot point above is less likely to be a problem with the 2007 (ISIC Rev. 4) version 
of the definition because the definition is narrower and more focused on ICT activities. The 
second dot point is likely to still apply (though with an increase in the size of the 
telecommunications industry in most countries, may reduce in significance). 

Implementation of the revised definition 

Implementation of the 2006-07 ICT sector definition is not feasible until a majority of 
OECD countries are using ISIC Rev. 4 in their national statistical systems. Until then, the 
2002 version will continue to be used as a basis of data collection. 

The Content and media sector definition 
History 

The WPIIS started working on a definition of "content" industries in 1998. A brief 
history of this work is presented here. 4 

• 1997 meeting - The need for a definition of the Content sector is highlighted. At its first 
meeting, the ICCP Statistical Panel (later WPIIS) discussed the development of an 
activity-based ICT sector definition. Several delegates at that meeting expressed a desire 
to see the definition expanded to include content-producing industries. 

• 1998 meeting - A step-by-step approach is adopted. It was agreed that to "reach 
agreement a pragmatic, step-by-step approach would need to be adopted where initially 
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an industry definition for ICT would be pursued and then, once achieved, a broader 
definition of the "information economy" would be developed that included not only ICT 
but also content industries". Having this in mind, it was agreed to exclude the content 
related ISIC 2230 (Reproduction of Recorded Media) and 9213 (Radio and Television 
Services) from the proposed definition of the ICT sector (except where transmission of 
radio and television programs was done as part of the work of a business classified to 
ISIC 9213). 

• 1999 meeting - A "broad" definition of the content sector. At the 1999 WPIIS meeting, 
Canada and France presented a proposal for an activity-based definition of the Content 
sector "Defining the Content Sector: a Discussion Paper". This proposal was based on the 
new concept of a "communication product", defined as the combination of medium and 
content. The term "communication" was preferred to the term "information" because 
the latter refers to a particular type of content. It was also suggested that, in order to 
define the content sector, it is important to distinguish the "creator" and "promoter" of 
the communication product; the promoter being the taker of the risk for marketing the 
communication product. Delegates felt that the proposed industry definition of the 
Content sector was too broad and would lead to inappropriate statistical information 
being compiled. There was considerable discussion on the principles guiding a definition 
of content activities, particularly whether an activity could be included in the definition 
if it only had the capacity to produce communication products, without necessarily 
being involved in their production. The consensus among delegates was that more work 
in the elaboration of these basic principles was needed. Delegates also made the point 
that content goods and services could be produced by many industries but generally only 
as a small part of their total activities. 

• 2000 meeting - From "content sector" to "electronic content sector and electronic 
communication products". At the 2000 WPIIS meeting, the Secretariat presented a paper 
that argued for defining "the electronic content sector and electronic communication 
products" and then discussed how these might best be measured. Some delegates were 
concerned that the electronic content sector as defined would not really answer the 
questions being asked by their users. Some questioned whether an electronic content 
sector existed at all. Finally other delegates thought that a better approach might be to 
treat the electronic content sector, not as a separate sector but as merely one component 
of an overall content sector. It was argued that this would lead to a much more useful set 
of outputs including measurement of the transition to an electronic information society. 
France, on the other hand, was in favour of adopting the approach outlined in the paper. 

• 2001 meeting - A "narrow" definition of a content sector and the need to look at 
products that can be delivered electronically. Following the 2000 discussion, a new 
French-Canadian discussion paper, "The Content Sector: Outline and Features" was 
presented to the 2001 meeting. "Content" was defined as: 

* an organised message intended for human beings; 

* resulting from an organised production activity; 

* combined with, or carried by, a medium; 

* whose diffusion is not restricted to a list of privileged recipients; 

* whose diffusion requires a communication medium, i.e. a mass diffusion medium; and 

* also requires the intervention of a publisher, that is, of a publishing business. 
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These criteria had led the authors to identify a set of industries whose principal activity 
would be the publishing of content products. Some member countries were not 
enthusiastic about limiting the process to what were termed "publishing industries" and 
the proposal was put that the issue be broadened to all products that could be delivered 
electronically. The argument was that economic consequences of electronic delivery 
were of considerable policy importance. Several delegates expressed interest in 
enlarging the set of industries to education, health services and other industries where 
ICT is having a profound impact on the way the product is delivered. The United States 
proposed an alternative approach of focusing on electronic delivery of content and 
services by particular sectors. It was also argued that the user requirements for data on 
the supply side should not be disconnected with the ones guiding measurement on the 
demand side. In the latter area, an interest in the issues of banking, education and 
access to government services on line had clearly emerged. 

• 2002 meeting - The topic of "content" was not on the agenda. However, during the 2002 
meeting under the agenda item "Measuring activities and products in the information 
economy", France tabled a room document where an attempt was made to delimit the 
Information economy. This paper defined the information economy as the sum of the 
ICT sector and the content sector and proposals for criteria for these sectors and related 
products were introduced. 

• 2004 meeting - The Secretariat produced a paper in the context of examining user needs 
and measurement challenges more generally. The paper summarised past WPIIS efforts 
in the area of content and presented some options for future work. There were two 
reasons cited in the paper for re-engaging in the discussion. The first related to the need 
to strengthen the link between WPIIS work and policy needs for measurement. The 
second related to the potential opportunity offered by the 2007 revisions of the CPC and 
ISIC. Importantly, the paper extended the debate to digitised products. The outcome of 
the meeting was that the OECD would initiate an exploratory collection of the supply of 
some information/digital products and refine questions on digital products contained in 
the ICT use surveys. 5 

• 2006 meeting - A proposal for a "content and media" sector definition based on the draft 
ISIC Rev. 4 was put to the 2006 WPIIS meeting. With the more widespread inclusion of an 
"information" sector or similar in industrial classifications (including ISIC Rev. 4), it was 
considered likely that agreement on a definition of the sector could be reached. The 
development of a content and media sector definition occurred during 2006. 

• 2007 - The Content and media sector definition was released (OECD, 2006b). 

An agreed definition (2006-07) 6 

The interest in the "content sector" originated in the belief that the rapid 
transformation and diffusion of information and communication technologies would have 
a significant impact on industries that create and distribute content (e.g. text, audio, video), 
particularly those that create and distribute content to a wide audience. The structural 
changes seen since then in the distribution of news, music and video are good examples of 
those impacts. 

In 2002, the North American Industry Classification System (NAICS) introduced an 
information sector within its structure. That represented a significant departure from the 
tradition in that it brought together industries that were previously seen as belonging to 



162 



OECD GUIDE TO MEASURING THE INFORMATION SOCIETY 2011 © OECD 2011 



7. CONTENT AND MEDIA 



different sectors of the economy: publishing, motion picture and sound recording, 
broadcasting and telecommunications, information services and data processing. The 
common thread between those industries is that they all include organisations primarily 
engaged in the creation and dissemination (except by wholesale or retail methods) of 
information and cultural products, or in providing the means to process and disseminate those 
products. 

While the initial version of the North American Industry Classification System used to 
be the only classification to recognise an information sector, it is now an integral part of the 
latest ISIC and NACE as well as national classifications (e.g. the Japanese classification and, 
the Australian-New Zealand classification). 7 Thus, there is a growing recognition of the 
close tie between industries that create and disseminate mass market information and 
cultural products in their various forms (content industries) and the industries that provide 
the means to disseminate those products (ICT industries). 

A proposal was submitted to the 2006 WPIIS meeting for discussion . It included the 
following ISIC Rev. 4 industries: 



Group 


Class 


Title 


181 




Printing and service activities related to printing 




1811 


Printing 




1812 


Service activities related to printing 


182 


1820 


Reproduction of recorded media 


581 




Publishing of books, periodicals and other publishing activities 




5811 


Book publishing 




5812 


Publishing of directories and mailing lists 




5813 


Publishing of newspapers, journals and periodicals 




5819 


Other publishing activities 


582 


5820 


Software publishing 


Content retail trade 




4761 


Retail sale of books, newspapers and stationary 




4762 


Retail sale of music and video recordings 


Content renting 




7722 


Renting of video tapes and disks 


591 




Motion picture, video and television programme activities 




5911 


Motion picture, video and television programme production activities 




5912 


Motion picture, video and television programme post-production activities 




5913 


Motion picture, video and television programme distribution activities 




5914 


Motion picture projection activities 


592 


5920 


Sound recording and music publishing activities 



Though this particular proposal was not retained, there was near unanimous support 
for the adoption of a content and media sector definition. In particular, there was broad 
support for a definition that includes all industries of Division J of ISIC (Information and 
communication) except those that are already included in the ICT sector definition. 

There was some debate over the placement of multimedia software publishing and 
broadcasting activities, with the former eventually included in the ICT sector (because ISIC 
does not recognise a separate multimedia software industry) and the latter in the Content 
and media sector. Details can be found in the discussion on the ICT sector definition above. 
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The resulting agreed definition of the Content and media sector is shown in Box 7.A1.3 
below. The guiding principle is as follows: 

"The production (goods and services) of a candidate industry must primarily be 
intended to inform, educate and/or entertain humans through mass communication 
media. These industries are engaged in the production, publishing and/or the 
distribution of content (information, cultural and entertainment products), where 
content corresponds to an organised message intended for human beings." 8 



Box 7.A1.3. The 2006-07 OECD Content and media sector definition 

(based on ISIC Rev. 4)* 

Publishing of books, periodicals and other publishing activities 

- 5811 Book publishing 

- 5812 Publishing of directories and mailing lists 

- 5813 Publishing of newspapers, journals and periodicals 

- 5819 Other publishing activities 

Motion picture, video and television programme activities 

- 5911 Motion picture, video and television programme production activities 

- 5912 Motion picture, video and television programme post-production activities 

- 5913 Motion picture, video and television programme distribution activities 

- 5914 Motion picture projection activities 
Sound recording and music publishing activities 

- 5920 Sound recording and music publishing activities 
Programming and broadcasting activities 

- 6010 Radio broadcasting 

- 6020 Television programming and broadcasting activities 
Other information service activities 

- 6391 News agency activities 

- 6399 Other information service activities n.e.c. 

* From OECD (2006a). The codes and titles were checked against the final (November 2008) 
version of ISIC Rev. 4. 



Implementation of the definition of the Content and media sector 

Like the revised ICT sector, implementation of the definition is not feasible until a 
majority of OECD countries are using ISIC Rev. 4 in their national statistical systems. 

Notes 

1. Much of the material in this section is taken from OECD (2006a). 

2. ISIC 3312 - Manufacture of instruments and appliances for measuring, checking, testing, 
navigating and other purposes, except industrial process control equipment and 3313 - 
Manufacture of industrial process control equipment. 
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3. IPTV is a system whereby a digital television signal is delivered using the Internet protocol. It can 
take various forms and can be delivered over different types of networks, but it is most commonly 
commercially supplied over closed network architectures (DSL or VDSL television by telecom 
operators and digital television by cable operators). Those establishments are typically classified in 
ISIC Division 61 - Telecommunications. They do not usually engage in the development of 
channels and programming, only in the transmission of channels and programming developed by 
others. 

4. The notes in this section are adapted from the WPIIS summary records from 1998 to 2003, and the 
summary record of the 2004 WPIIS meeting. Additional material was added in respect of events 
occurring after 2004. 

5. Only the second of these tasks was completed. 

6. Much of the material in this section is taken from OECD (2006a). 

7. Although the sector is not identical from one classification to the other, the underlying principles 
are very similar. 

8. The guiding principle in this form was developed after the finalisation of the sector definition and 
was communicated by WPIIS to the UNSD to be included in an annex to ISIC Rev. 4. 
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This chapter concludes the Guide with an overview of the international activities 
for measuring ICTs and future challenges. 
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Introduction 

Measurement of the information society is a relatively new field and much of it is 
based on concepts, definitions, standards and methods described in this Guide. Details of 
the measurement work done by OECD member countries can be found in Annex 8.A1, 
while Annex 8.A2 and Annex 8.A3 provide details of measurement efforts in a number of 
non-OECD economies. 

Clearly much has been accomplished and our understanding of the role of ICT is 
greatly improved. However, it is still early by historical standards - as the list of challenges 
at the end of this chapter attests. 

The international scene 

One of the most exciting developments in the area of information society has been the 
expansion of interest on a global scale. Exploiting the linkages between ICT and economic 
development is now a key priority not only for developed countries, but also for many 
developing economies, donors and international organisations. 

However, the task is long-term in nature and far from trivial. As stakeholders try to 
identify and measure what amounts to a complex reality, they realise that there are 
significant statistical challenges to overcome. Even where harmonised and well-defined 
indicators exist (for instance, those collected globally by the ITU), there are challenges 
resulting from rapid technological change - as well as changes in how technology is being 
used. 

Context 

While efforts by member countries were co-ordinated through the OECD and found a 
common forum in the WPIIS, a number of non-OECD countries started measurement 
initiatives for the information society in the late 1990s (in some cases, with the support of 
the OECD through its outreach activities). From the outset, the importance of international 
comparability was evident and thus regional initiatives were formed, usually with the 
participation of at least one OECD member country. 

Historical efforts to co-ordinate global initiatives in respect of ICT development stretch 
back more than two decades. In 1984, the ITU commissioned the Maitland Report and this 
was followed a decade later by the Buenos Aires Declaration on Global Telecommunication 
Development for the 21st Century. 

The Okinawa charter of the G8 in July 2000 started by saying that ICT is "... one of the 
most potent forces in shaping the twenty-first century" (G8, 2000) and continued by placing 
emphasis on the enabling and transforming nature of ICT, both economically and socially. 
Bridging the digital divide and seizing digital opportunities became influential global 
drivers. "Creating digital opportunities is not something that happens after addressing the 
"core" development challenges; it is a key component of addressing those challenges in the 
21st century" (G8, 2001). 
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The Digital Opportunity Taskforce (DOT Force) was formed in 2000 to facilitate this 
process through: fostering policy, regulatory and network readiness; improving 
connectivity, increasing access and lowering costs; building human capacity; and 
encouraging participation in global e-commerce networks (G8, 2001). In addition to 
representatives from G8 countries, the DOT Force included members from developing 
economies, international organisations, businesses and non-profit organisations. The 
Genoa Plan of Action was drafted in 2001, while its implementation and follow-through 
were discussed in Kananaskis (G8, 2002), where the formal process was concluded. 

In April 2006, the Global Alliance for ICT and Development (GAID) was approved by the 
Secretary-General of the UN. "The Alliance responds to the need and demand for an 
inclusive global forum and platform for cross-sectoral policy dialogue on the use of ICT for 
enhancing the achievement of internationally agreed development goals, notably 
reduction of poverty" (see iuiuiu.un-gaid.org). 

The international interest in information society issues increased significantly with 
the organisation of the two World Summits on the Information Society (WSIS, Geneva 2003 
and Tunis 2005). The 2003 Summit brought a higher global profile to the topic and helped 
solidify and intensify work related to ICT. The Declaration of Principles from the Geneva 
meeting recognised the potential of ICT as a driver for progress and stated that: "We are 
firmly convinced that we are collectively entering a new era of enormous potential, that of 
the information society and expanded human communication." It also reinforced the 
commitment of the international community to "evaluate and follow-up progress in 
bridging the digital divide", as well as "strengthening co-operation to seek common 
responses to the challenges and to the implementation of the Plan of Action" (WSIS, 
2003 a). 

By their nature, the Summits provided a forum for the discussion of many aspects of 
the information society including measurement. The Plan of Action stated that: "A realistic 
international performance evaluation and benchmarking (both qualitative and 
quantitative) through comparable statistical indicators and research results, should be 
developed to follow up the implementation of the objectives, goals and targets in the Plan 
of Action, taking into account different national circumstances" (WSIS, 2003b). 

The 2003 WSIS Plan of Action made a number of suggestions concerning the 
development of statistical indicators for benchmarking and performance evaluation, to 
follow up the implementation of the WSIS Plan and to track global progress in the use of 
ICT. It called upon all countries and regions to develop tools to provide statistical 
information, and to set up coherent and internationally comparable indicator systems. 
It also outlined a series of "indicative targets" to be achieved by 2015, relating to the use of 
ICT - in the areas of community access, education, health, science, culture, government 
and broadcasting. 

As an outcome of the second phase of WSIS in November 2005, the Tunis Agenda for 
the Information Society called for "periodic periodic evaluation, using an agreed 
methodology, such as described in paragraphs 113-120" (paragraph 112) and stated that in 
paragraph 114: "The development of ICT indicators is important for measuring the digital 
divide. We note the launch, in June 2004, of the Partnership on Measuring ICT for Development, 
and its efforts..." (WSIS, 2005). 
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Direct statistical mobilisation 

While conferences and other meetings dedicated to the information society have 
increased over recent years, measurement issues were often subsumed under policy 
themes and dealt with in a piecemeal fashion. With the exception of the OECD and 
Eurostat, and the more recent initiatives discussed elsewhere, there were few international 
meetings of information society statisticians (OECD/UN/UNDP/World Bank Forum, 2003). 
However, the need for reliable and comparable statistical information had risen in 
importance and, indeed, had become a priority, leading to an increased level of attention to 
measurement issues in recent years. 

In 2002, a meeting of the International Association for Official Statistics (IAOS) took 
place in London. Although its theme was more general in nature - looking at the 
measurement issues associated with the so-called "new economy" - many ICT-related 
issues were discussed. The conclusions and recommendations from the meeting were 
submitted to the UN Statistics Division and, in addition to specific statistical issues, 
emphasis was placed on the need for more investment in information society measures in 
order "to build evidence on access, adoption and impact of ICT and electronic networks for 
business and households" (ONS, 2002a, b). 

The International Telecommunication Union (ITU) organises its World 
Telecommunication/ICT Indicators Meetings (WTIM) annually, bringing together policy 
makers, regulators and national statistical offices. The purpose of the WTIM is to discuss 
topics related to the identification, definition, collection, processing, dissemination and 
use of telecommunication/ICT indicators and to enhance collaboration between the 
different parties involved - at national, regional and international level. 

An international meeting that directly solicited the participation of producers of 
statistical information took place in Geneva in September 2003. Having earlier received the 
mandate by its governing body to make measurement a priority, the United Nations 
Conference on Trade and Development (UNCTAD) extended invitations to statistical offices of 
all countries to discuss the state of, and prospects for, statistical measurement of e-commerce 
and e-business. The objective of the meeting was to provide a framework for introducing 
developing economies' views into the ongoing debates on digital economy statistics and 
indicators, and to provide a forum for statisticians of all countries. Country experiences 
were shared and the needs of developing economies were heard, in particular the need for 
training. In collaboration with the OECD, an effort started to identify a core set of indicators 
(Schaaper, 2003), that would be suitable for all countries, and a decision was made for the 
creation of a virtual forum that would continue the dialogue (UNCTAD, 2003). 

Perhaps the most influential meeting aimed at information society statistics on a 
global scale occurred under WSIS in December 2003. Jointly organised by the UNECE, 
UNCTAD, ITU, UIS, OECD and Eurostat (UNECE, 2003a, b), the Statistical Workshop on 
"Monitoring the Information Society: Data, Measurement and Methods" was attended by a 
great number of countries and representatives from international organisations. The 
outcomes of the meeting included the production of this Guide by the OECD, and 
recommendations for further work towards measuring the information society. In 
particular, the meeting encouraged countries to collect data on ICT in various areas, and to 
develop tools to measure the impacts of ICTs. The workshop recommended that data 
collection should be integrated within systems of official statistics and that policy makers 
and administrators should be involved in this process. 
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Partnership on Measuring ICT for Development 1 

The Geneva phase of WSIS highlighted the importance of benchmarking and 
measuring progress toward the information society through internationally comparable 
statistical indicators (Geneva Plan of Action, para. 28). In response to this, the Partnership on 
Measuring ICT for Development was subsequently launched at UNCTAD XI in Sao Paulo in 
June 2004. 

The Tunis phase of WSIS recognized that the development of ICT indicators is 
important for measuring the digital divide, and called upon countries and international 
organizations to allocate appropriate resources for the provision of ICT statistics and to 
develop effective measurement methodologies, including basic ICT indicators and an 
analysis of the state of the Information Society (Tunis Agenda for the Information Society, 
para. 112-120). 

In particular, member States called for periodic evaluation, using an agreed 
methodology, and referring to the work of the Partnership on Measuring ICT for Development. 

In 2008, the UN Economic and Social Council recommended that the Partnership 
continue working on ICT measurement to track progress in the achievement of WSIS goals 
and targets. 2 In 2009, it recognized the work of the Partnership, its institutional 
strengthening and the creation of a working group to measure the economic and social 
impact of ICTs, and recommended that the Partnership consider the creation of benchmarks 
and impact indicators for further consideration by the United Nations Statistical 
Commission. 3 

The Partnership was created to accommodate and further develop various initiatives 
regarding the availability and measurement of ICT indicators at the regional and 
international levels. It provides an open framework for co-ordinating ongoing and future 
activities. The Partnership is a joint effort among all stakeholders involved, based on an 
inclusive approach and the principle of equality among the partners involved. It 
particularly aims to assist developing economies in their efforts to produce information 
society statistics by mobilising the resources necessary to build local capacities. Ideally, 
this will result in an expansion of ICT statistics harmonised internationally, providing a key 
input to future policy and analytical work on the information society, including the digital 
divide. Continued coordination and co-operation among Partners have enabled the 
Partnership to make significant progress in its methodological work, capacity building and 
data dissemination activities. For more information on the various activities of the 
Partnership since its launch, see: measuring-ict.unctad.org. 

The definition of a core list of ICT indicators has been one of the main achievements 
of the Partnership. 4 The core list was endorsed by the UN Statistical Commission on March 
2007 and was revised in 2009. The core list was the outcome of an intensive consultation 
process by the Partnership with national statistical offices (NSOs) worldwide, based on 
internationally agreed standards. The core indicators are recommended by the Partnership 
as a basis for the collection of ICT statistics that could be comparable at the international 
level, and that will support the formulation and evaluation of ICT policies. 

Several countries have already integrated the core list of ICT indicators into their 
existing household and business surveys. 
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The current Partnership core ICT indicators list is composed of 46 ICT indicators and 
two reference indicators in the following areas: 

• ICT infrastructure and access (10 indicators); 

• ICT access and use by households and individuals (12 indicators and one reference 
indicator); 

• ICT access and use by enterprises (12 indicators); 

• ICT sector and trade in ICT goods (4 indicators); 

• ICT in education (8 indicators and one reference indicator). 

The complete Partnership core ICT indicators list is presented in Annex 8.A3. 

A further eight core indicators on ICT in government are expected to be added to the 
list in 2011, after consultation work is finalised. The development of ICT indicators is a 
continuous process, and the list will undergo periodic review. As countries gain experience 
in the collection of ICT data, and as policy needs evolve, indicators may be modified, 
removed or added. The nature of ICTs themselves is dynamic, and indicators and 
definitions should be adapted as technology progresses, such as broadband speeds or 
mobile applications and capabilities. 

Other methodological work of the Partnership is organised around task groups, each 
one led by a volunteering organisation, and including the partner organisations that are 
involved in the respective activities, as well as any others that are invited to participate. 
Currently, these include a task group on education indicators, a task group on government 
indicators, a capacity building task group, a task group on measuring ICT impact, and a 
task group to develop indicators to measure WSIS targets. 

OECD's role in the Partnership 

OECD's main contributions to the Partnership are: 

• the collection and provision of metadata information for OECD countries as part of the 
global stocktaking exercise; 

• assistance with the development of a common list of core ICT indicators (for instance, 
Schaaper, 2003); 

• assistance with methodological work associated with the core indicators through 
several means, including this Guide (for instance, Roberts, 2005a, b); 

• contribution to the development of training material for capacity building, in particular 
by providing material from this Guide; and 

• participation in the development of a global database of ICT indicators, mainly by 
providing data for OECD countries and for some non-OECD countries. 

Future challenges for the OECD 

While continuing to develop indicators to measure the "readiness" for the information 
society and the "use" of ICT, the WPIIS and other areas of the OECD are responding to 
measurement needs that are increasingly sophisticated. A major challenge is developing 
new indicators in areas that are inherently difficult to measure - because the concepts are 
undefined, complex or dynamic. Examples include: 

• e-business (see the discussion in Chapter 5); 

• ICT expenditure and investment (see Chapter 5); 
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• ICT education and skills, and ICT occupations; 

• outsourcing; 

• trust in the online environment (see Annex 5A.1); 

• social and economic impacts of ICT (a discussion can be found in Chapters 4, 5 and 6); and 

• following significant activity during 2006 and 2007 to update ICT sector and product 
classifications and to introduce new classifications for "content and media", the 
challenge remains for member countries and the OECD to compile data using these 
classifications. 

Conclusion 

The current situation surrounding information society measurement inspires 
cautious optimism. As ICT increasingly affects our economies and societies, it is evident 
that the value of quantitative information is appreciated more than before. Nevertheless, 
the magnitude of the task ahead cannot be underestimated. The production and intelligent 
use of the resource that quantitative information represents is plagued by many problems, 
including the state and capacity of statistical infrastructures, budgetary constraints and 
trade-offs, and cultural attitudes towards information. In addition, specific areas of 
measurement require a certain know-how and come with their own body of knowledge. This 
is particularly the case for the information society, considering the newness of the area. 

To impart this know-how to a larger community is a key objective of this Guide. 
Statisticians and users of such information in countries who initiate information society 
measurement should not have to start from the beginning, as their counterparts did a few 
years ago. On the contrary, they can benefit from a ready resource - at least to the extent 
that its boundaries stretch at the present time. In addition to obvious benefits, it will 
immediately increase the value of new outputs as they will meet the requirement of 
international comparability. 

It is frequently argued that the reality of developing economies is different; therefore, 
adaptations must be introduced to existing statistical recommendations prior to their 
implementation. The appropriateness of the household unit as a unit of observation is just 
one example. In the context of developing economies, the argument goes, the notion of a 
household is not the same considering the housing situation, the more communal 
attitudes of people and the generally larger family size. It is acknowledged that there will 
be areas where cultural and structural differences will necessitate adaptation, both for 
national needs and international relevance. Annex 8. A3 of this Guide provides 
recommendations to developing economies concerning the applicability of the concepts 
elaborated in this Guide and in some cases discusses possible adaptations. 

But while the need for adaptation may be true, there are no compelling reasons why 
the underlying conceptual and definitional work contained here would not be generally 
applicable. There is no reason, for example, why the definition of the ICT sector, the 
definition of e-commerce or the definitions of ICT products cannot be applied to developed 
and developing economies alike. 

The creation of the Partnership on Measuring ICT for Deuelopment, bringing together most 
of the relevant international organisations, has been an important step in bringing pioneer 
methodology on ICT measurement to developing economies. At the same time, this 
development will also allow developing economies to contribute to the global stock of 
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knowledge and to aid in future developments. The Partnership has set itself some ambitious 
goals, which, if met, will help to close part of the data gap that exists between developed 
and developing economies. 
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ANNEX 8.A1 



Member Countries' ICT Statistics 
Collection Work 

This annex consists of a brief overview and a web link to the OECD ICT statistics 
metadata "homepage" (www.oecd.org/sti/ictmetadata). The entries found there constitute a 
significant repository of information about ICT statistical work undertaken by official 
statisticians of OECD countries. The aims of Annex 8.A1 are to: 

• provide a valuable information base for countries (both member and non-member) 
undertaking survey development work in this area; 

• be a documentation repository on a public website of potential use to OECD countries 
that may use the links to provide a reference to their own work on ICT statistics; and 

• be a metadata repository for the OECD (and other agencies that collect ICT statistics) to 
assist in data interpretation and to provide information on methods of ICT 
measurement. 

Features of country entries in this annex are: 

• Metadata were initially collected in early 2005 and subsequently revised in late 2005 and 
early 2007. Reference dates are included for each country's entry. 

• Content is limited to official statistics (including administrative data collated and 
released as official statistics) and analyses based on those statistics. 

• Content covers general information, metadata on ICT collection activity and information 
on cross-cutting and analytical work based on official statistics. 

• Entries are generally completed in such a way that they only need to be updated 
annually. 

• Data in respect of some statistical work undertaken by countries that participate in the 
Eurostat community surveys have been obtained directly from Eurostat in order to 
reduce burden on participating countries. Eurostat collects detailed metadata from 
participating countries in respect of their ICT use surveys. 

• Countries are encouraged to include web links and contacts' e-mail addresses where 
they exist and are both specific (for instance, a link to information about a particular 
statistical collection) and reasonably stable (not likely to be broken in the annual 
timeframe envisaged). 

It is expected that countries will be asked to provide updates periodically. The timing 
of revisions is likely to be co-ordinated with other events, for instance, ICT data collections, 
WPIIS meetings or revisions to the Guide. 
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ANNEX 8.A2 



Non-member Economies 

The objective of this annex is to give information about the collection of ICT indicators 
outside the OECD region. This will be done in four separate sections as follows: 

1. Availability of core ICT indicators on ICT infrastructure and access in non-OECD 
economies (ITU). 

2. Availability of the core ICT indicators on access to, and use of ICT by households and 
individuals in non-OECD economies (ITU). 

3. Availability of the core ICT indicators on use of ICT by businesses in non-OECD 
economies (UNCTAD). 

4. Availability of the core ICT indicators in ICT in education in non-OECD economies 
(UNESCO). 

Readers should note the efforts of the Partnership on Measuring ICT for Development in 
establishing an agreed set of core ICT indicators including definitions, model questions 
and methodological recommendations. The Partnership's main objective in undertaking 
this work is to enable the production of internationally comparable data on various aspects 
of ICT. An important goal of the Partnership is to help countries (and particularly those in 
the developing world) to develop ICT surveys or add suitable questions to existing 
collections. In March 2007, the UN Statistical Commission endorsed the core list of ICT 
indicators and encouraged countries to use it in their data collection programmes (UNSC, 
2007; Partnership on Measuring ICT for Development, 2007). The core list was revised in 2010 
and is shown in Annex 8.A3 (Partnership, 2010). More information about the Partnership can 
be found in Chapter 8. 

The availability tables hereafter show only the non-OECD member economies for 
which data are available. If an economy does not collect any data then it has not been 
included in the table. And core ICT indicators for which coverage is too poor have not been 
included by the collecting agency (ITU, UNCTAD, UNESCO). Note, the designations 
employed and the presentation of the material in this annex do not imply the expression 
of any opinion whatsoever on the part of the Secretariat of the United Nations concerning 
the legal status of any country, territory, city or area or of its authorities, or concerning the 
delimitation of its frontiers or boundaries. Where the designation "country or area" 
appears, it covers countries, territories, cities or areas. 
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Core ICT indicators on ICT infrastructure and access 

There are ten core indicators on ICT infrastructure and access. There are two broad 
types of infrastructure and access indicators - those where a higher value implies a better 
situation in terms of ICT infrastructure and access development, and the tariff indicators, 
where a lower value usually indicates a better situation. The complete list of core 
indicators is shown in Annex 8.A3. 



Table 8.A2.1. Availability of the core ICT indicators on ICT infrastructure 
and access, 2009 or latest available year 





Fixed telephone lines 
per 100 inhabitants 


Mobile cellular subscriptions per 
100 inhabitants 


Internet subscriptions 
per 100 inhabitants 


Fixed broadband subscriptions 
per 100 inhabitants 


Mobile cellular subscriptions with access 
to data communication at broadband 
speed per 100 inhabitants 


International Internet bandwidth 
per inhabitant 


Percent coverage of mobile cellular 
network (population) 


Fixed broadband Internet monthly 
subscription (USD) 


Mobile cellular prepaid tariffs (per month), 
in USD, and as a percentage of 
monthly per capita income 


A 1 

At 


A9 
A^ 


AQ 

Ao 


A4 


At; 
AO 


AC 
AO 


A7 
A/ 


At} 

AO 


a n 
Aa 


Afghanistan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Albania 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Algeria 


✓ 


✓ 




✓ 


✓ 




✓ 


✓ 


✓ 


American Samoa 


✓ 








✓ 










Andorra 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Angola 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Antiqua and Barbuda 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Arqentina 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Armenia 


✓ 


✓ 




✓ 


✓ 






✓ 


✓ 


Aruba 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Azerbaijan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Bahamas 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Bahrain 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Bangladesh 


✓ 


✓ 




✓ 


✓ 


✓ 




✓ 


✓ 


Barbados 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Belarus 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Belize 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Benin 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Bermuda 


✓ 


✓ 




✓ 


✓ 






✓ 




Bhutan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Bolivia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Bosnia and Herzegovina 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Botswana 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Brazil 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Brunei Darussalam 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 




Bulgaria 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Burkina Faso 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Burundi 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Cambodia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Cameroon 


✓ 


✓ 




✓ 


✓ 


✓ 




✓ 


✓ 


Cape Verde 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Cayman Islands 


✓ 


✓ 






✓ 




✓ 






Central African Rep. 


✓ 


✓ 




✓ 


✓ 






✓ 


✓ 
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Table 8.A2.1. Availability of the core ICT indicators on ICT infrastructure 
and access, 2009 or latest available year (cont.) 





Fixed telephone lines 
per 100 inhabitants 


Mobile cellular subscriptions per 
100 inhabitants 


Internet subscriptions 
per 100 inhabitants 


Fixed broadband subscriptions 
per 100 inhabitants 


Mobile cellular subscriptions with access 
to data communication at broadband 
speed per 100 inhabitants 


International Internet bandwidth 
per inhabitant 


Percent coverage of mobile cellular 
network (population) 


Fixed broadband Internet monthly 
subscription (USD) 


Mobile cellular prepaid tariffs (per month), 
in USD, and as a percentage of 
monthly per capita income 


At 


AO 

A^ 


AQ 

Ad 


A/1 

A4 


AK 

AO 


A C 

Ab 


A7 

A/ 


A D 

Ao 


a n 

Ay 


Chad 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 




China 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Colombia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Comoros 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Congo 


✓ 


✓ 




✓ 


✓ 


✓ 








Conqo (Democratic Republic of the! 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Costa Rica 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Cote d'lvoire 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Croatia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Cuba 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Cyprus 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Djibouti 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Dominica 


✓ 


✓ 




✓ 


✓ 






✓ 


✓ 


Dominican Republic 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Ecuador 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Egypt 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


El Salvador 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Equatorial Guinea 


✓ 


✓ 




✓ 


✓ 






✓ 


✓ 


Eritrea 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Ethiopia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 




Faroe Islands 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 




✓ 


Fiji 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




FYR Macedonia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


French Guiana 


✓ 


✓ 




✓ 










✓ 


French Polynesia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Gabon 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Gambia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Georgia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Ghana 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Gibraltar 


✓ 


✓ 


✓ 


✓ 


✓ 








✓ 


Greenland 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






Grenada 


✓ 


✓ 


✓ 


✓ 








✓ 




Guam 


✓ 






✓ 


✓ 






✓ 


✓ 


Guatemala 


✓ 


✓ 




✓ 


✓ 


✓ 




✓ 




Guinea 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Guinea-Bissau 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 


Guyana 


✓ 


✓ 




✓ 




✓ 


✓ 


✓ 




Haiti 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 


Honduras 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Hong Kong, China 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




India 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 
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Table 8.A2.1. Availability of the core ICT indicators on ICT infrastructure 
and access, 2009 or latest available year (cont.) 





Fixed telephone lines 
per 100 inhabitants 


Mobile cellular subscriptions per 
100 inhabitants 


Internet subscriptions 
per 100 inhabitants 


Fixed broadband subscriptions 
per 100 inhabitants 


Mobile cellular subscriptions with access 
to data communication at broadband 
speed per 100 inhabitants 


International Internet bandwidth 
per inhabitant 


Percent coverage of mobile cellular 
network (population) 


Fixed broadband Internet monthly 
subscription (USD) 


Mobile cellular prepaid tariffs (per month), 
in USD, and as a percentage of 
monthly per capita income 


A1 


A2 


A3 


A4 


A5 


A6 


A7 


A8 


A9 


Indonesia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Iran 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Iraq 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 


Jamaica 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Jersey 


✓ 
















✓ 


Jordan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Kazakhstan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Kenya 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Kiribati 


✓ 


✓ 




✓ 


✓ 








✓ 


Kuwait 


✓ 


✓ 




✓ 


✓ 


✓ 




✓ 




Kyrgyzstan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Laos 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Latvia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Lebanon 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Lesotho 


✓ 


✓ 




✓ 


✓ 


✓ 




✓ 


✓ 


Liberia 


✓ 


✓ 


✓ 




✓ 








✓ 


Libya 


✓ 


✓ 




✓ 


✓ 


✓ 




✓ 




Liechtenstein 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Lithuania 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Macao, China 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Madagascar 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Malawi 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Malaysia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Maldives 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Mali 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Malta 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Marshall Islands 


✓ 


✓ 




✓ 


✓ 








✓ 


Mauritania 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Mauritius 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Micronesia (Fed. States of) 


✓ 


✓ 




✓ 


✓ 


✓ 




✓ 


✓ 


Moldova 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Mongolia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Monteneqro 
Morocco 


✓ 
✓ 


✓ 
✓ 


✓ 


✓ 
✓ 


✓ 
✓ 


✓ 
✓ 




✓ 
✓ 


✓ 
✓ 


Mozambique 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Myanmar 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Namibia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Nauru 


✓ 








✓ 








✓ 


Nepal 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 




Netherlands Antilles 


✓ 








✓ 






✓ 


✓ 


New Caledonia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Nicaragua 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 




Niger 


✓ 


✓ 




✓ 


✓ 


✓ 




✓ 


✓ 
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Table 8.A2.1. Availability of the core ICT indicators on ICT infrastructure 
and access, 2009 or latest available year (cont.) 





Fixed telephone lines 
per 100 inhabitants 


Mobile cellular subscriptions per 
100 inhabitants 


Internet subscriptions 
per 100 inhabitants 


Fixed broadband subscriptions 
per 100 inhabitants 


Mobile cellular subscriptions with access 
to data communication at broadband 
speed per 100 inhabitants 


International Internet bandwidth 
per inhabitant 


Percent coverage of mobile cellular 
network (population) 


Fixed broadband Internet monthly 
subscription (USD) 


Mobile cellular prepaid tariffs (per month), 
in USD, and as a percentage of 
monthly per capita income 


A1 


A2 


A3 


A4 


A5 


A6 


A7 


A8 


A9 


Nigeria 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Northern Mariana Islands 


✓ 






✓ 


✓ 






✓ 


✓ 


Oman 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Pakistan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Palau 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Panama 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Papua New Guinea 


✓ 


✓ 




✓ 


✓ 


✓ 




✓ 




Paraguay 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Peru 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Philippines 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Puerto Rico 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Qatar 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Romania 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Russia 


✓ 


✓ 




✓ 


✓ 


✓ 




✓ 


✓ 


Rwanda 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Saint Kitts and Nevis 


✓ 


✓ 




✓ 


✓ 






✓ 


✓ 


Saint Lucia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Samoa 


✓ 


✓ 




✓ 


✓ 






✓ 


✓ 


San Marino 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Sao Tome and Principe 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Saudi Arabia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Senegal 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Serbia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Seychelles 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Sierra Leone 


✓ 


✓ 




✓ 


✓ 






✓ 


✓ 


Singapore 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Solomon Islands 


✓ 


✓ 




✓ 


✓ 






✓ 




Somalia 


✓ 


✓ 




✓ 


✓ 








✓ 


South Africa 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 




Sri Lanka 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




St. Vincent and the Grenadines 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Sudan 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Suriname 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Swaziland 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Syria 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Chinese Taipei 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Tajikistan 


✓ 


✓ 




✓ 


✓ 


✓ 




✓ 


✓ 


Tanzania 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 




Thailand 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Timor-Leste 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Togo 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Tonga 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Trinidad and Tobago 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 
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Table 8.A2.1. Availability of the core ICT indicators on ICT infrastructure 
and access, 2009 or latest available year (cont.) 





Fixed telephone lines 
per 100 inhabitants 


Mobile cellular subscriptions per 
100 inhabitants 


Internet subscriptions 
per 100 inhabitants 


Fixed broadband subscriptions 
per 100 inhabitants 


Mobile cellular subscriptions with access 
to data communication at broadband 
speed per 100 inhabitants 


International Internet bandwidth 
per inhabitant 


Percent coverage ot mobile cellular 
network (population) 


Fixed broadband Internet monthly 
subscription (USD) 


Mobile cellular prepaid tariffs (per month), 
in USD, and as a percentage of 
monthly per capita income 


A1 


A2 


A3 


A4 


A5 


A6 


A7 


A8 


A9 


Tunisia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Turkmenistan 


✓ 


✓ 




✓ 


✓ 


✓ 






✓ 


Tuvalu 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Uganda 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Ukraine 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 




United Arab Emirates 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Uruguay 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Uzbekistan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Vanuatu 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Venezuela 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Viet Nam 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


Virgin Islands (US) 


✓ 






✓ 


✓ 






✓ 


✓ 


Yemen 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 



..: Not available. 



1. Footnote by Turkey: The information in this document with reference to "Cyprus" relates to the southern part of the Island. 
There is no single authority representing both Turkish and Greek Cypriot people on the Island. Turkey recognizes the Turkish 
Republic of Northern Cyprus (TRNC). Until a lasting and equitable solution is found within the context of United Nations, 
Turkey shall preserve its position concerning the "Cyprus issue". 

2. Footnote by all the European Union Member States of the OECD and the European Commission: The Republic of Cyprus is 
recognized by all members of the United Nations with the exception of Turkey. The information in this document relates to 
the area under the effective control of the Government of the Republic of Cyprus. 

Source: International Telecommunication Union (ITU), World Telecommunication/ICT Indicators database, December 2010. 



Gore ICT indicators on access to, and use of, ICT by households 
and individuals 

There are core 12 indicators on access to, and use of, ICT by households and 
individuals - six on household access to ICT and six on the use of ICT by individuals. There 
is also a reference indicator on access to electricity by households. The complete list of core 
indicators is shown in Annex 8.A3. 
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8. THE INTERNATIONAL SCENE AND THE ROAD AHEAD 



Table 8.A2.2. Availability of the core ICT indicators on access to, and use of, 
ICT by households and individuals in non-OECD member economies, 
2009 or latest available year 





Proportion of households with a radio 


Proportion of households with a TV 


Proportion of households 
with a fixed line telephone 


Proportion of households with 
a mobile cellular telephone 


Proportion of households with a computer 


Proportion of individuals who 
used a computer 
(from any location) in the last 12 months 


Proportion of households with 
Internet access at home 


Proportion of individuals who used the Internet 
(from any location) in the last 12 months 


Proportion of individuals who used 
a mobile cellular telephone 


Proportion of households with electricity 


HH1 


HH2 


HH3 


HH3bis 


HH4 


HH5 


HH6 


HH7 


HH10 


HHR1 


Afghanistan 










✓ 




✓ 








Albania 










✓ 




✓ 








Algeria 










✓ 




✓ 








Andorra 














✓ 








Angola 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Antigua and Barbuda 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 








Argentina 










✓ 




✓ 








Armenia 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 








Azerbaijan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Bahrain 










✓ 


✓ 


✓ 


✓ 


✓ 




Bangladesh 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Barbados 














✓ 








Belarus 




✓ 


✓ 




✓ 




✓ 


✓ 




✓ 


Benin 




✓ 






✓ 




✓ 








Bermuda 










✓ 


✓ 


✓ 


✓ 






Bhutan 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Bolivia 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Bosnia and Herzegovina 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Botswana 










✓ 




✓ 








Brazil 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 




Brunei Darussalam 










✓ 




✓ 








Bulgaria 




✓ 






✓ 


✓ 


✓ 


✓ 


✓ 




Burkina Faso 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 






✓ 


Cambodia 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 








Cameroon 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 






✓ 


Cape Verde 




✓ 






✓ 






✓ 








Cayman Islands 




✓ 


✓ 


✓ 


✓ 






✓ 








Chad 










✓ 






✓ 








China 










✓ 






✓ 








Colombia 




✓ 


✓ 


✓ 


✓ 






✓ 








Comoros 










✓ 






✓ 








Congo 










✓ 






✓ 








Congo (Democratic Republic of the) 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 






✓ 


Costa Rica 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Cote d'lvoire 










✓ 




✓ 








Croatia 




✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Cuba 










✓ 




✓ 








Cyprus 




✓ 






✓ 


✓ 


✓ 


✓ 


✓ 




Djibouti 






✓ 


✓ 


✓ 




✓ 








Dominican Republic 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 
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Table 8.A2.2. Availability of the core ICT indicators on access to, and use of, 
ICT by households and individuals in non-OECD member economies, 
2009 or latest available year (cont.) 





Proportion of households with a radio 


Proportion of households with a TV 


Proportion of households 
with a fixed line telephone 


Proportion of households with 
a mobile cellular telephone 


Proportion of households with a computer 


Proportion of individuals who 
used a computer 
(from any location) in the last 12 months 


Proportion of households with 
Internet access at home 


Proportion of individuals who used the Internet 
(from any location) in the last 12 months 


Proportion of individuals who used 
a mobile cellular telephone 


Proportion of households with electricity 


HH1 


HH2 


HH3 


HH3bis 


HH4 


HH5 


HH6 


HH7 


HH10 


HHR1 


Ecuador 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Egypt 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


El Salvador 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 




✓ 


Eritrea 










✓ 




✓ 








Ethiopia 






✓ 




✓ 




✓ 








Fiji 












✓ 




✓ 








FYR Macedonia 












✓ 


✓ 


✓ 


✓ 


✓ 




Gabon 












✓ 






✓ 








Gambia 




✓ 








✓ 






✓ 








Georgia 


✓ 


✓ 








✓ 






✓ 






✓ 


Ghana 


✓ 


✓ 






✓ 


✓ 






✓ 






✓ 


Greenland 


















✓ 








Guatemala 




✓ 








✓ 






✓ 








Guinea 












✓ 






✓ 








Guinea-Bissau 












✓ 






✓ 








Guyana 












✓ 














Haiti 












✓ 






✓ 








Honduras 


✓ 


✓ 








✓ 






✓ 


✓ 


✓ 


✓ 


Hong Kong. China 




✓ 








✓ 


✓ 


✓ 


✓ 


✓ 




India 




✓ 








✓ 




✓ 








Indonesia 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 




✓ 


Iran 




✓ 






✓ 




✓ 


✓ 






Jamaica 


✓ 


✓ 






✓ 




✓ 






✓ 


Jordan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Kazakhstan 




✓ 






✓ 




✓ 








Kenya 










✓ 




✓ 








Kuwait 










✓ 




✓ 








Kyrgyzstan 




✓ 


✓ 


✓ 


✓ 




✓ 








Laos 










✓ 




✓ 








Latvia 










✓ 


✓ 


✓ 


✓ 


✓ 




Lebanon 






✓ 




✓ 




✓ 








Lesotho 










✓ 




✓ 








Liberia 


✓ 


✓ 




✓ 


✓ 










✓ 


Libya 










✓ 




✓ 








Lithuania 










✓ 


✓ 


✓ 


✓ 


✓ 




Macao, China 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 




✓ 


Madagascar 


✓ 




✓ 


✓ 


✓ 




✓ 








Malawi 


✓ 


✓ 






✓ 




✓ 








Malaysia 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Maldives 










✓ 




✓ 








Mali 




✓ 






✓ 




✓ 
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Table 8.A2.2. Availability of the core ICT indicators on access to, and use of, 
ICT by households and individuals in non-OECD member economies, 
2009 or latest available year (cont.) 





Proportion of households with a radio 


Proportion of households with a TV 


Proportion of households 
with a fixed line telephone 


Proportion of households with 
a mobile cellular telephone 


Proportion of households with a computer 


Proportion of individuals who 
used a computer 
(from any location) in the last 12 months 


Proportion of households with 
Internet access at home 


Proportion of individuals who used the Internet 
(from any location) in the last 12 months 


Proportion of individuals who used 
a mobile cellular telephone 


Proportion of households with electricity 


HH1 


HH2 


HH3 


HH3bis 


HH4 


HH5 


HH6 


HH7 


HH10 


HHR1 


Malta 




✓ 






✓ 


✓ 


✓ 


✓ 


✓ 




Mauritania 










✓ 




✓ 








Mauritius 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Moldova 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Mongolia 




✓ 






✓ 




✓ 






✓ 


Montenegro 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 








Morocco 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Mozambique 






✓ 




✓ 




✓ 








Myanmar 










✓ 




✓ 








Namibia 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Nepal 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


New Caledonia 










✓ 




✓ 








Nicaragua 




✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Niger 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Nigeria 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Oman 




✓ 






✓ 


✓ 


✓ 


✓ 






Pakistan 




✓ 






✓ 




✓ 








Panama 


✓ 


✓ 


✓ 




✓ 




✓ 








Papua New Guinea 










✓ 




✓ 








Paraguay 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 




✓ 


Peru 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 




✓ 


Philippines 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Qatar 




✓ 


✓ 


✓ 


✓ 




✓ 








Romania 










✓ 


✓ 


✓ 


✓ 


✓ 




Russia 




✓ 






✓ 


✓ 


✓ 


✓ 






Rwanda 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Saint Kitts and Nevis 


✓ 


✓ 






✓ 










✓ 


Saudi Arabia 










✓ 




✓ 








Senegal 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Serbia 




✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Seychelles 










✓ 




✓ 








Sierra Leone 


✓ 


✓ 


✓ 


✓ 












✓ 


Singapore 






✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




South Africa 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Sri Lanka 


✓ 


✓ 






✓ 




✓ 






✓ 


St. Vincent and the Grenadines 










✓ 




✓ 








Sudan 










✓ 




✓ 








Suriname 






✓ 


✓ 


✓ 




✓ 








Swaziland 










✓ 




✓ 






✓ 


Syria 










✓ 




✓ 








Chinese Taipei 




✓ 






✓ 




✓ 
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Table 8.A2.2. Availability of the core ICT indicators on access to, and use of, 
ICT by households and individuals in non-OECD member economies, 
2009 or latest available year (cont.) 





Proportion of households with a radio 


Proportion of households with a TV 


Proportion of households 
with a fixed line telephone 


Proportion of households with 
a mobile cellular telephone 


Proportion of households with a computer 


Proportion of individuals who 
used a computer 
(from any location) in the last 12 months 


Proportion of households with 
Internet access at home 


Proportion of individuals who used the Internet 
(from any location) in the last 12 months 


Proportion of individuals who used 
a mobile cellular telephone 


Proportion of households with electricity 


HH1 


HH2 


HH3 


HH3bis 


HH4 


HH5 


HH6 


HH7 


HH10 


HHR1 


Tajikistan 










✓ 




✓ 








Tanzania 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 






✓ 


Thailand 
Togo 


✓ 


✓ 


✓ 


✓ 


✓ 
✓ 


✓ 


✓ 
✓ 


✓ 


✓ 


✓ 


Trinidad and Tobago 










✓ 




✓ 








Tunisia 










✓ 




✓ 








Turkmenistan 










✓ 




✓ 








Uganda 


✓ 


✓ 


✓ 




✓ 




✓ 






✓ 


Ukraine 


✓ 


✓ 






✓ 




✓ 


✓ 




✓ 


United Arab Emirates 


✓ 


✓ 






✓ 


✓ 


✓ 


✓ 




✓ 


Uruguay 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Uzbekistan 










✓ 




✓ 








Vanuatu 










✓ 












Venezuela 


✓ 


✓ 






✓ 




✓ 








Viet Nam 




✓ 


✓ 




✓ 




✓ 






✓ 


Yemen 










✓ 




✓ 








Zambia 


✓ 


✓ 




✓ 


✓ 




✓ 






✓ 


Zimbabwe 










✓ 




✓ 









. . : Not available. 

1. See note to Table 8A2.1. 

Source: International Telecommunication Union (ITU), World Telecommunication/ICT Indicators database, December 2010. 
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Table 8.A2.3. Availability of the core ICT indicator: Individuals who used the Internet 
in the last 12 months, by location (HH8), in non-OECD member economies, 

2009 or latest available year 



Proportion of individuals who used the Internet in the last 1 2 months, by location of use (HH8) 





At home 


At work 


At place of 
education 


At another 
person's home 


At mm mi i n itv 

Internet access 
facility 


At rnmmprrial 

Internet access 
facility 


At anu nlarp via a 

r\L ally ^laUC via a 

mobile cellular 
telephone 


At anv nlarp via 

r\L ally uluUG Via 

other mobile 
access devices 


Azerbaijan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Belarus 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Brazil 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Bulgaria 


✓ 


✓ 


✓ 


✓ 






✓ 


✓ 


Colombia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Costa Rica 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Croatia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Cyprus 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Ecuador 


✓ 


✓ 


✓ 


✓ 




✓ 




✓ 


El Salvador 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


FYR Macedonia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Hong Kong, China 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 




Latvia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Lithuania 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Macao, China 


✓ 


✓ 


✓ 




✓ 








Malta 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Mauritius 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Morocco 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Nicaragua 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Oman 


















Palestinian Authority 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Paraguay 


✓ 


✓ 


✓ 


✓ 




✓ 






Peru 


✓ 


✓ 


✓ 


✓ 




✓ 






Qatar 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Romania 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Serbia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Singapore 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Thailand 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






Ukraine 


✓ 


✓ 


✓ 


✓ 


✓ 








United Arab Emirates 


✓ 


✓ 


✓ 












Uruguay 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 







..: Not available. 

1. See note to Table 8A2.1. 

Source: International Telecommunication Union (ITU), World Telecommunication/ICT Indicators database, December 2010. 
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Core ICT indicators on use of ICT by businesses 

There are 12 core indicators on use of ICT by businesses. The complete list of core 
indicators is shown in Annex 8.A3. 



Table 8.A2.4. Availability of the core ICT indicators on use of ICT by businesses 
in non-OECD member economies, 2009 or latest available year 



Proportion of: 



Proportion of enterprises with: 





;es using 


employed 


;es using 


employed 


website 


intranet 


ig orders 


rders over 


3 modem 








connection 


oadband 


3S of access 


wband 




a 

cr 

Q 

a 
re 
o 


a network 


:tranet 










CO 
£Z 








o 
cn 


ZJ 

cn 




iz 


-Q 
T3 


o 


o 




c 
_a 




CD 


CD 
£Z 




Entei 


Perse 


Entei 


Perst 




-CZ 

. • 

.. ■ 


CD 
O 

CD 


Placir 


c 
<1 










Fixed I 


<D 
X 

U ~ 


Other n 






E 

c 




Local 


< 




B1 


B2 


B3 


B4 


B5 


B6 


B7 


B8 


B9 


a 


B9 


b 


B9 


c 


B9.d 


B9 


e 


B9.n 


B9. 


n 


B10 


B11 


Argentina 


✓ 




✓ 




✓ 


✓ 


✓ 


✓ 








✓ 




✓ 


✓ 


✓ 


✓ 


Azerbaijan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 


✓ 


Belarus 


✓ 




✓ 




✓ 






















✓ 




Bermuda 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




















Brazil 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 








✓ 




✓ 


✓ 


✓ 


✓ 


Bulgaria 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 








✓ 




✓ 




✓ 


✓ 


China 






✓ 




✓ 




✓ 


✓ 


✓ 


✓ 












✓ 




Hong Kong, China 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 








✓ 




✓ 


✓ 


✓ 


✓ 


Macao, China 


✓ 




✓ 








✓ 


✓ 
































Colombia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 








✓ 


* 




* 


✓ 














✓ 


✓ 


Croatia 


✓ 




✓ 




✓ 


✓ 


✓ 


✓ 
















✓ 






✓ 


t 


✓ 




✓ 


✓ 


Cuba 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 


✓ 


Cyprus 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 
















✓ 






✓ 




✓ 


✓ 


Egypt 










✓ 


✓ 


✓ 


















✓ 






✓ 






✓ 


FYR Macedonia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 
















✓ 






✓ 


✓ 


✓ 


✓ 


India 


✓ 












































Jordan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 
















✓ 






✓ 








✓ 


✓ 


Kazakhstan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 
















✓ 






✓ 


t 


✓ 




✓ 


✓ 


Kyrgyzstan 


✓ 




✓ 




✓ 






















✓ 














✓ 




Latvia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 
















✓ 






✓ 








✓ 


✓ 


Lesotho 


✓ 


✓ 


✓ 




✓ 






















✓ 






✓ 












Lithuania 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 
















✓ 






✓ 








✓ 


✓ 


Malta 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 
















✓ 






✓ 








✓ 


✓ 


Mauritius 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


































Mongolia 


✓ 
















































Panama 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 
















✓ 


✓ 


Qatar 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 














✓ 




✓ 








✓ 


✓ 


Romania 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 














✓ 






✓ 








✓ 


✓ 


Russian Federation 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 








✓ 






✓ 








✓ 


✓ 


Senegal 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 








✓ 




✓ 


✓ 


✓ 


✓ 


Serbia 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 








✓ 


✓ 


Singapore 


✓ 




✓ 




✓ 


✓ 


✓ 


✓ 








✓ 




✓ 


✓ 


✓ 




Suriname 






✓ 




✓ 


























Thailand 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 




✓ 


✓ 










United Arab Emirates 


✓ 




✓ 




✓ 


✓ 


✓ 


✓ 








✓ 




✓ 




✓ 


✓ 


Uruguay 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 


✓ 



Proportion of enterprises accessing the Internet by: 



Proportion of 
enterprises: 



..: Not available. 
-: Magnitude nil. 
1. See note to Table 8.A2.1. 

Source: United Nations Conference on Trade and Development (UNCTAD), December 2010. 
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Table 8.A2.5. Availability of the core ICT indicators on use of ICT by businesses 
in non-OECD member economies, 2009 or latest available year 



Proportion of enterprises using the Internet for: 





Sending and receiving e-mail 


Information about goods 
or services 


Information from public 
authorities 


0 Information searches 
or research 


Internet banking or accessing 
other financial services 


Internet banking 


accessing other 
financial services 


Interacting with general 
government organisations 


Providing customer services 


Delivering products online 


Other types of activity 


Telephoning over the 
InternetA/olP 


Instant messaging, 
bulletin boards 


Staff training 


Internal or external 


B12.a 


B12.b.i 


B12.b.ii 


B12.b.iii 


B12.C 


B12.c.i 


B12.c.ii 


B12.d 


B12.6 


B12.f 


B12.g 


B12.h 


B12.i 


B12.j 


B12. 


Argentina 


y/ 


y/ 








y/ 




y/ 


y/ 


y/ 














Azerbaijan 






✓ 




✓ 






y/ 


















Belarus 


































Bermuda 


































Brazil 


y/ 


y/ 








y/ 




y/ 


y/ 


y/ 










y/ 




Bulgaria 






y/ 






y/ 




y/ 


y/ 












y/ 




China 


1/ 


y/ 


y/ 


✓ 








y/ 


y/ 


y/ 














Hong Kong, China 


y/ 


y/ 


y/ 






y/ 


y/ 




y/ 


y/ 




y/ 










Colombia 


y/ 


y/ 


y/ 


✓ 


✓ 






y/ 


y/ 


y/ 














Croatia 






y/ 






y/ 




y/ 














y/ 




Cuba 


✓ 


✓ 


y/ 


✓ 


✓ 








y/ 


y/ 


y/ 












Cyprus 






y/ 










y/ 




y/ 


y/ 












y/ 




Egypt 


y/ 


y/ 


y/ 










y/ 




y/ 


y/ 


y/ 














FYR Macedonia 






y/ 










y/ 




y/ 














y/ 




India 
Jordan 


y/ 


y/ 


y/ 
















y/ 


y/ 




y/ 










Kazakhstan 


✓ 


✓ 


✓ 










✓ 




✓ 


✓ 


✓ 












✓ 


Kyrgyzstan 


✓ 




✓ 


















✓ 














Latvia 






✓ 










✓ 




✓ 


✓ 












✓ 




Lesotho 


✓ 


✓ 














✓ 




















Lithuania 






✓ 










✓ 




✓ 


✓ 












✓ 




Malta 






✓ 










✓ 




✓ 


✓ 












✓ 




Mauritius 






































Mongolia 






































Panama 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 


✓ 




✓ 












Qatar 


✓ 


✓ 


✓ 






✓ 




✓ 


✓ 
















Romania 






✓ 






✓ 




✓ 


✓ 












✓ 




Russian Federation 


✓ 


✓ 


✓ 






✓ 




✓ 




✓ 




✓ 






✓ 


✓ 


Senegal 


✓ 


✓ 


✓ 






✓ 






✓ 
















Serbia 






✓ 


✓ 


✓ 






✓ 


















Singapore 


✓ 


✓ 


✓ 






✓ 




✓ 




✓ 




✓ 


✓ 


✓ 


✓ 


Suriname 
































Thailand 

United Arab Emirates 


✓ 
✓ 


✓ 
✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 
✓ 


✓ 
✓ 


✓ 










Uruguay 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 


✓ 


✓ 













E 



..: Not available. 

1. See note to Table 8A2.1. 

Source: United Nations Conference on Trade and Development (UNCTAD), December 2010. 
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Core ICT indicators in ICT in education 

There are eight core indicators on ICT in education and one reference indicator on 
proportion of schools with electricity. The complete list is shown in Annex 8.A3. These 
indicators are new to the list of core ICT indicators, although they have been in development 
by the UNESCO Institute for Statistics (UIS) for several years. The ICT in education indicators 
have been subject to extensive testing and consultation. The key principles for selection of 
the indicators include policy relevance, feasibility of reliable data collection, minimization of 
data collection burden and international comparability (UIS, 2009). 



Table 8.A2.6. Availability of the core ICT indicators on ICT in education 
in non-OECD member economies, 2009 or latest available year 





Infrastructure (electricity and old technology in 
schools) 


Infrastructure 
(computers in schools) 


Infrastructure (Internet in schools) 


Learners 
and ICT 
usage 


Teaching 
staff and 
ICTs 


Proportion of schools 
with electricity 


Proportion of schools with 
a radio used for educational purposes 


Proportion of schools with a television 
used for educational purposes 


Proportion of schools with a telephone 
communication facility 


Learners-to-computer ratio in schools with 
computer-assisted instruction 


Learners-to-computer for 
pedagogical use ratio 


Proportion of schools with 
Internet access 


Proportion of schools with fixed 
narrowband Internet access 
(using modem dial-up, ISDN) 


Proportion of schools with fixed 
broadband Internet access 
(DSL, cable, other fixed broadband) 


Proportion of learners who 
have access to the Internet at school 


Proportion of ICT-qualified teachers 
in primary and secondary schools 


EDR1 


ED1 


ED2 


ED3 


ED4 


ED4bis 


ED5a. 


ED5b. 


ED5c. 


ED6 


ED8 


Argentina 


✓ 






✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Bahrain 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


Belarus 


✓ 






✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


Costa Rica 


✓ 


✓ 


✓ 


✓ 






✓ 






✓ 


✓ 


Dominican Republic 






✓ 


✓ 






✓ 








✓ 


Egypt 


✓ 


✓ 




✓ 






✓ 


✓ 


✓ 




✓ 


Ethiopia 


✓ 




✓ 








✓ 










Ghana 


✓ 






✓ 














✓ 


Guatemala 


✓ 


✓ 


✓ 


✓ 






✓ 










Jordan 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Malaysia 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Mauritius 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




Morocco 


✓ 






✓ 






✓ 




✓ 




✓ 


Oman 


✓ 


✓ 


✓ 


✓ 






✓ 


✓ 


✓ 






Palestine 


✓ 


✓ 


✓ 


✓ 






✓ 








✓ 


Paraguay 


✓ 






✓ 






✓ 








✓ 


Russian Federation 


✓ 






✓ 






✓ 


✓ 


✓ 






Senegal 


✓ 












✓ 










Tunisia 


✓ 










✓ 


✓ 








✓ 


Uruguay 


✓ 






✓ 






✓ 




✓ 







..: Not available. 
-: Magnitude nil. 
. Category not applicable. 

Source: UNESCO Institute for Statistics (UIS), December 2010. 
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ANNEX 8.A3 



Measurement Issues for Developing Economies 

Introduction 

This annex provides an overview of measurement of the information society from the 
perspective of non-OECD economies. Its aim is to facilitate applicability of the Guide to 
those economies, thus improving prospects for internationally comparable data in this 
area. 

Readers should also note the efforts of the Partnership on Measuring ICT for Development 
in establishing an agreed set of core ICT indicators including definitions, model questions 
and methodological recommendations (2005, 2008, 2010). The Partnership's main objective 
in undertaking this work is to enable the production of internationally comparable data on 
various aspects of ICT. An important goal of the Partnership is to help countries (and 
particularly those in the developing world) to develop ICT surveys or add suitable questions 
to existing collections. In March 2007, the UN Statistical Commission endorsed the core list 
of ICT indicators and encouraged countries to use it in their data collection programmes 
(UNSC, 2007; Partnership on Measuring ICT for Development, 2007). The core list was 
revised in 2008 and in 2010 and is shown at the end of this annex. More information about 
the Partnership can be found in Chapter 8. 

It is important to note at the outset that measurement of the information society 
should be an integral part of a country's statistical system, with many concepts, 
classifications and methodologies being common to other areas of statistical enquiry. For 
instance, surveys of ICT use are not very different from other statistical surveys in terms of 
frames, sample selection, statistical units, questionnaire design, collection methodology or 
data processing. In fact, ICT use surveys can often be integrated with other surveys, thus 
reducing the costs of data collection. 

It is beyond the scope of this annex to explore all the initiatives of non-OECD countries 
in collecting ICT statistics. Instead, it will highlight areas where developing economies 
might diverge from OECD guidelines because of difficulties in measurement or because of 
the unique way in which the information society has evolved or taken shape within a 
particular country. The purpose of the annex is to expand the range of countries to which 
the Guide can be applied, by providing suggestions that take into account the different 
circumstances of statistically less advanced countries. It has been prepared with the least 
developed economies particularly in mind. 1 Countries in more advanced stages of 
development are likely to move towards direct use of the standards set by OECD and 
therefore some of the issues discussed - and problems identified - here will be of less 
concern to them. 
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To assist with cross-referencing, the structure and content of the annex broadly 
follows that of the Guide. 

Measuring the information society in developing economies 

Information on availability, access and use of ICT is being collected by a range of 
national, regional and international organisations. For instance, all of the ICT 
infrastructure and access core indicators, and the indicators on household ICT access and 
individual ICT use proposed by the Partnership on Measuring ICT for Deuelopment are already 
being collected and disseminated by the ITU. ITU data are collected primarily through 
annual questionnaires addressed to countries, usually the regulatory telecommunication/ 
ICT authority, the Ministry in charge of telecommunication/ICT and national statistical 
offices (NSOs). The core indicators on ICT use by businesses are collected by UNCTAD, 
through an annual survey usually directed to NSOs. 

In spite of the leading place that the Internet and computers occupy in discussions of 
public policy, ICT in the context of developing economies could include "traditional" or 
"older" technologies (such as radio and television) as well. For example, by 2010, the 
proportion of households with a TV is approaching 80 per cent, globally. In Africa, however, 
only about 30 per cent of households have a television (ITU, 2010a). Measures, such as 
those established by the Partnership on the number of television and radio sets per 
100 inhabitants, would help address the information needs in this area. 2 

Although the Guide deals with ICT measurement, it is worth considering the following 
guiding principles that govern any measurement activities, but which may be of greater 
relevance to developing economies. 

• Countries may have different priorities for data collection. They may not be able to afford 
dedicated surveys on ICT. Instead, they may be able to include ICT related questions in 
existing surveys, some of which include background information (e.g. demographic and 
socio-economic data in social surveys). 

• National Statistical Offices and other agencies with a role in the collection of official 
statistics have a strong part to play in co-ordination as well as standard setting and data 
collection. 3 It is essential that metadata systems are incorporated into such 
developments in order to capture information essential to informed use of national data. 

• A methodology that is appropriate to the circumstances should be used. It should be 
needs-driven and relate to local cultural determinants, with variables that can be 
captured accurately and adequately. It might evolve from a first-time collection of 
essential core indicators to a more sophisticated collection of elaborate disaggregated 
indicators. 

• Caution should be exercised that international comparisons take into account the 
different circumstances of countries and their economic and social situation. Analyses 
and best practice examples 4 can help countries to learn from others' experiences in data 
collection. 5 Ideally, countries will adopt recommendations of the Partnership (2010) for 
standardised metadata associated with ICT measurement (for instance, on scope and 
classifications). 

ICT products 

The main uses of an ICT product classification in a country's statistical system are for 
measuring trade in, production of, expenditure on, and use of, ICT products. 
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The OECD started revising its ICT goods classification in 2006 and finalised an ICT 
products classification in 2008 (see Chapter 2 for details). The full list of categories included 
in the ICT product classification can be found in Annex 2.A1 of this Guide. 

Relevant Partnership indicators for ICT product measurement are currently limited to 
international trade in ICT goods. 

ICT infrastructure 

ICT infrastructure is a crucial resource for an information society. As newer 
technologies emerge, they create the challenge of establishing infrastructure able to meet 
demand. For this reason, measurement of infrastructure may precede measurement of 
products or usage. 6 

Many developing economies suffer from a lack of the basic infrastructure needed to 
build a solid ICT base, such as electricity and roads. ITU data show that in many developing 
economies, the majority of fixed telephone lines are concentrated in urban areas. The 
evolving mobile network infrastructure has significantly reduced the urban-rural gap and 
mobile cellular networks today are providing access to previously unconnected areas. ITU 
estimates that by 2010, only about 10 per cent of the world's population is not living within 
reach of a mobile cellular signal, and in Africa, over 50 per cent of the rural population are 
covered (ITU, 2010a). Given the increasing spread of high speed mobile broadband (3G and 
beyond) networks, these developments are also providing unprecedented opportunities for 
bringing broadband Internet access to rural and remote areas. 

In some non-OECD countries, providing access to information through public access 
points is an important element of the national ICT strategy. Data on crucial aspects of ICT 
infrastructure will not be complete unless use of such public Internet access points is 
included in surveys and preferably extended to include use by socially excluded and 
marginalised groups. 

The Partnership's core indicators include one on individual Internet use by location that 
has community Internet access facility as a response category. 

International bandwidth is a critical infrastructure component and is of importance to 
many developing economies. However, bandwidth linking developing nations and the 
developed world is scarce and expensive. There is also a critical lack of connectivity 
between developing nations (particularly in Africa), meaning that inter-regional 
communications must often be routed over long and expensive inter-continental routes. 
Bandwidth data collected by the ITU show that developing economies still have 
considerably less bandwidth than developed countries. 

While not all developing economies have deployed broadband technologies, more and 
more countries are starting to use high speed Internet access, particularly in the business 
sector. Fixed and mobile broadband access are important indicators that are included in 
the Partnership's core list and collected by the ITU and UNCTAD. 

When newer technologies, such as mobile phones, are introduced to a local market, it 
is important to consider the "leap-frogging" effect of such technology. For example, the 
number of mobile phone subscriptions exceeds the number of fixed lines in the majority of 
developing economies, 7 and some countries are reconsidering their policies for landline 
provision. Reflecting this trend, one of the core ICT infrastructure indicators proposed by 
the Partnership (2010) is Mobile cellular telephone subscriptions per 100 inhabitants, an 
indicator that is tracked by the ITU. Another trend for developing economies is to leap 
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straight to wireless technology for Internet access. Though such technologies may not be 
the preferred option in all situations, they offer the advantage of avoiding the necessity of 
laying landlines in rugged or inhospitable terrain. 

ICT supply 

In the OECD conceptual framework, "ICT supply" refers to the ICT sector, whose 
component industries are defined as follows: "The production (goods and services) of a 
candidate industry must primarily be intended to fulfil or enable the function of 
information processing and communication by electronic means, including transmission 
and display" (OECD, 2006). OECD revised the definition in 2006 in order to be consistent 
with the revised ISIC Rev. 4 (UNSD, 2008). An outcome of the revision was that the ICT 
sector definition was more restricted than the original concept (which dated from 1998). 
See Chapter 4 and Annex 7.A1 for more information. 

It may be useful for country surveys to consider whether the market in new 
technologies is led by imports or by local manufacturing businesses. One would normally 
assume that initial penetration takes place through imports; however, growth in local 
supplies might price out imported goods over time. During 2005, announcements by major 
suppliers to supply specially manufactured phones and computers to developing 
economies 8 suggest that there may be rapid changes in markets. These changes would 
ideally be captured statistically, for instance, by measuring the supply of such devices and 
their use by different groups. 

Patents, including those for ICT inventions, are regularly used as an index of 
innovation in the developed world, but a number of substantive barriers hinder their use 
outside OECD countries. Since Intellectual Property Rights (IPR) laws are not enforced 
properly in many developing economies, local patenting is seen as relatively ineffective. It 
should be noted that for most developing economies, the number of patents in the US, 
European and Japanese patent offices is negligible, and therefore not relevant for statistical 
analysis. 

National patent systems are not always comparable, for instance, some countries have 
a lower threshold when evaluating novelty and patentability of patent applications. 
Furthermore, national patent laws and regulations may change over time, making 
statistical time series difficult to interpret. 

ICT demand by businesses 

Many businesses in developed countries have moved beyond basic Internet access to 
a dynamic e-business infrastructure using technologies such as payment gateways, secure 
channels, digital certification and online tracking. In contrast, many developing economies 
still lack the basic human capital and infrastructure that would enable a sufficient market 
for online services and allow such transactions to be carried out reliably. As a consequence, 
many businesses in developing economies are still in the early stages of using ICTs, such 
as computers, the Internet and a basic website, rather than moving to e-business processes 
such as customer relationship management or supply chain management. Similarly, their 
use of the Internet is often focused on obtaining information about markets, or trying to 
identify international companies to which they could bid as suppliers. 

Therefore, not only do a lower proportion of businesses in most developing economies 
use ICT, but those that do are most likely to use simpler ICTs. Business surveys on the use 
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of ICT in non-OECD countries might therefore prefer to focus on the relatively simple core 
indicators identified by the Partnership. Several issues related to the measurement of the 
Partnership's core indicators on the use of ICT by businesses and on the ICT sector, and 
relevant to developing countries, are discussed in the UNCTAD Manual for the Production of 
Statistics on the Information Economy (UNCTAD, 2009). See also the comments in Chapter 5 on 
the statistical challenges of measuring e-commerce. Some of these (for instance, the 
challenge of reliably measuring a rare event) will be particularly applicable to many 
developing economies. 

The Partnership's core list does not include indicators on barriers, although these might 
be useful for individual countries. They include barriers relating to skills, finance, 
language, availability of content, quality and cost of infrastructure, and critical mass of 
users. 

While countries may establish a priority for measurement of trends in business use of 
ICT, such work may be hampered by problems in the statistical system. The potential for 
work on businesses can be severely limited by the absence of reliable business registers in 
some countries. In others, the capacity to carry out large-scale surveys is lacking. Such 
capacity may need to be built according to individual country requirements. If a 
comprehensive business register is not available for a country, then establishing one might 
be the first priority of statistical agencies. Volatile business demographics and a large 
informal sector are major issues hindering the development of business registers in many 
developing economies. Transparent metadata should be provided to indicate the sampling 
base for any business survey - especially where the sample frame has been limited by lack 
of complete or up-to-date information. 

ICT demand by households and individuals 

In developing economies, there are various socio-economic problems that create 
barriers to people owning, accessing and using ICT. These problems, amongst others, 
include illiteracy, language, socio-cultural barriers, lack of ICT skills (including keyboard 
skills), lack of access to ICT and low income. 

While the set of household and individual classificatory variables recommended by 
the Partnership (2010) represents a useful minimal set, it does not cover all these 
characteristics. Surveys of ICT penetration and use in developing economies may therefore 
need to consider a wider range of social factors and issues than proposed by the Partnership 
and collected annually by ITU. If such factors are not considered, there is a risk of 
incorrectly identifying reasons for low levels of ICT access and use in developing 
economies. 

In the majority of developing economies, household access to, and individual use of, 
computers and the Internet remains low. Community access potentially plays an 
important role in helping to overcome this divide - especially in rural areas. Several 
countries are taking steps to address this gap by increasing the number of public Internet 
access points, including in schools, libraries, cultural and other community centres. 

Radio and television are still the leading electronic means of information distribution 
in some developing economies (especially the least developed countries), particularly in 
rural and remote areas. "New" technologies, such as computers and Internet access, may 
only exist in urban areas. Such limitations in access mean that some developing 
economies might prefer to frame surveys according to those limits. However, for reasons of 
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international comparability, information collected from such surveys should be adjusted 
so that it represents the population of the entire country. 

International household surveys have seen increasing co-ordination in the last five 
years (in particular through the International Household Survey Network established by 
the World Bank in 2004) and there is increasing use of censuses and surveys in developing 
economies. Nevertheless, such surveys remain expensive. It is likely that with scarce 
resources, developing economies would not be able to run a dedicated ICT household 
survey more frequently than every few years. Such timing may not be frequent enough to 
capture the rapid pace of change that can ensue as a new technology enters a national 
market. It is thus almost certain that the majority of developing economies will want to 
add questions on ICT to existing multi-purpose, labour force or general household surveys. 

Such household surveys are characterised by competing interests and pressures to 
reduce interview time to a minimum. Countries would thus need to determine a small core 
set of key questions. Such core questions are unlikely to be the same as those chosen for 
OECD countries, but it is important that the small group of questions that are chosen are 
closely aligned with international guidelines to allow international comparisons and 
benchmarking. The core indicators on access to and use of, ICT by households and 
individuals that have been presented by the Partnership (2010) are likely to be a useful 
starting point. Given the comments above on the importance of barriers to ICT use, a 
question on household barriers (such as question 5 in the OECD model survey shown in 
Annex 6.A1) and/or individual barriers could be added to the core suite of questions for 
developing economies. 

The ITU Manual for Measuring ICT Access and Use by Households and Individuals (ITU, 2009) 
provides a comprehensive account of statistical standards and methodologies relevant to 
the collection of the core ICT household indicators developed by the Partnership. It has been 
specifically designed to assist developing countries in preparing household ICT surveys, 
and covers all necessary statistical standards and measurement topics. The technical 
manual provides detailed information on data sources and collection techniques, and 
covers the areas of questionnaire and survey design, data processing and quality, and 
information on the dissemination of household ICT data and metadata. The Manual also 
serves as the basis for ITU's training course on measuring ICT access and use by household 
and individual, which is being delivered to developing countries on a regular basis. 

Content 

Many developing economies have yet to agree on standards for representation codes 
of their languages, keyboard layouts and fonts. When languages are spoken across multiple 
countries whose publishers do not agree on standards, the situation gets still more 
complicated. Other challenges arise in the case of languages for which Internet domain 
names and e-mail identification must be typed using the Roman alphabet and not in the 
local language. 

Countries that want to use software in other national languages may have to translate 
the material and adapt it, as China has already been doing on a huge scale. However, this 
will increase costs, especially for countries with several languages, or several scripts. For 
example, Thailand has 74 living languages and China has 2 922 living languages. 9 

Work by researchers on the statistics of language use on the Internet has shown how 
the inherent technical bias of ICT in favour of Latin scripts and European languages 
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hinders the collection of accurate data on numbers of websites and pages by countries 
(Paolillo et al, 2005). 

Although the availability of local Internet infrastructure is increasing in many 
developing economies, it appears that relatively little local or indigenous content is being 
generated in some countries. This, of course, reflects the fact that it is often such groups 
who have the least access to the Internet. To support economic growth and development, 
the importance of access to local knowledge is important. There will be a need to preserve, 
protect, research and promote access to local knowledge in a climate where other 
predominant languages, such as English, are being used. 

In many developing economies, even where businesses have websites, these may be 
directed at an international rather than a local audience (and may therefore use English 
rather than local languages). Such websites are likely to have more information content 
than an interactive or transaction orientated content as there will be few domestic 
transactions in such circumstances, while international transactions may be infrequent 
and relatively expensive. Surveys of websites and domain names might wish to consider 
how best to capture this aspect of website content, and how to monitor any transition to a 
more interactive structure such as the construction of national "portals" for particular 
sectors or markets as domestic access to the web increases. 

There may be areas of content that are more appropriate for developing economies 
and to which surveys might pay special attention, websites on development projects 
themselves, often supported with imported donor technology, are a case in point. Online 
activities, assuming the availability of uninterrupted electricity and infrastructure, have 
the potential to address remote communities and excluded groups. There are many 
initiatives aimed at increasing the use of ICT in education that are targeted at rural and 
excluded groups. Countries might therefore wish to pay particular attention to content 
directed towards such groups, and seek to measure the degree to which such content is 
helping to bring excluded groups into the wider community. See also the Partnership's core 
indicators on ICT in education. 

In respect of measurement, countries should note the recent OECD sectoral and 
product classifications of Content and media that are described and detailed in this Guide. 

Other issues 

The "digital diuide" 

A considerable proportion of the population in developing economies is still excluded 
from the information society, especially from broadband Internet access. In other words, 
the social and economic divide is also "digital". ITU's ICT Development Index (IDI), 
published annually since 2009, tracks the digital divide by measuring the relative 
difference in IDI levels amongst economies and over time. The index is calculated from 
11 indicators and three sub indices: ICT access sub-index: fixed telephone lines per 
100 inhabitants, mobile cellular subscriptions per 100 inhabitants, international Internet 
bandwidth (bits/second per Internet user), proportion of households with a computer, and 
proportion of households with Internet access; ICT use sub-index: Internet users per 100 
inhabitants, fixed broadband Internet subscriptions per 100 inhabitants, and mobile 
broadband subscriptions per 100 inhabitants; and ICT skills sub-index: adult literacy rate, 
and gross school enrolment rates (secondary and tertiary levels); (ITU, 2010b). 
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There are several dimensions to the digital divide that go beyond basic ICT access, use 
and skills. They imply a variety of societal concerns about education and capacity building, 
social equity including gender equity and the appropriate use of technology. In particular, 
it has been noted that in more traditional societies, barriers may be more social and 
cultural than economic. Furthermore, among such barriers, the key role of education 
should be noted in creating access opportunities and awareness, and providing potential 
users with the skills needed to use ICT effectively. 

The Guide has suggested that simple penetration rates may not be appropriate for 
addressing the digital divide as they tend to emphasise the "haves" rather than the "have- 
nots". However, as this annex has indicated, many developing economies are still at a very 
early stage in adoption of ICT and may not have the resources for collecting more complex 
indicators on a regular basis. For this reason, it is recommended that non-OECD countries 
consider simple penetration indicators, at least where ICT development is at an early stage 
and a sophisticated market does not exist. The Partnership's core ICT indicators include 
appropriate intensity indicators such as the proportion of individuals using the Internet 
classified by gender or highest education level received. 

Considerations of cost and the limitations of the statistical system apply to some 
aspects of digital divide measurement. Resource issues may prevent much sub-national 
analysis, especially in trying to draw a valid sample in an area, or for a social group, where 
little ICT is in use. Under these circumstances, this annex suggests that it may be more 
appropriate for surveys to concentrate on ICT infrastructure indicators. 

E-government 

Several developing economies have realised the role that ICT can play in delivering 
government services, and have started implementing innovative models that may be 
technically simple but are already dramatically changing the way information is 
distributed within society. The success of such schemes is often limited by the small 
proportion of citizens who are able to use the technologies required for access. 

Because of the potentially important role of government in developing economies in 
introducing new technologies, e-government issues, and therefore measurement, are 
likely to be important. 

In developed countries, new technologies can be introduced directly to the individual 
consumer. In developing economies, new technologies may be introduced through 
community services such as public access points or community telecentres. Developing 
economies may therefore have to rely on government or other donors to introduce 
networked services and infrastructure rather than waiting for the market or private 
industry to do so. It may thus be useful to collect e-government indicators such as the 
availability of websites and electronic services. However, note the comments in Annex 5.A1 
on the challenges of collecting statistical information from the public sector. Such 
challenges are likely to apply to both OECD and developing economies. 

However, there are a number of barriers that hinder a country's measurement of 
e-government and these apply to both developing and other countries. 

Eight core indicators on ICT in government are expected to be added to the Partnership 
core ICT list in 2011, after consultation work is finalised. 
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Education and training 

Some studies (for example, the SITES studies 10 ) have shown that ICT plays a role in 
improving the quality of formal education in school classrooms and in encouraging further 
supplemental learning by students at their homes. Data on availability of ICT in formal 
education, its costs and benefits, use, equity of access and impact in terms of educational 
outcomes are very useful in the context of planning formal education programmes. 

It is often understood that the main reason for using ICT in the classroom is to better 
prepare the current generation of students for a workplace where ICT, particularly 
computers, the Internet and related technologies, is becoming much widely used. 
Computer literacy - the ability to use ICT effectively and efficiently - thus gives a 
competitive edge in an increasingly globalised job market, and tests of ICT skills, such as 
the International Computer Driving Licence, 11 are becoming more common. 

In a move to put in place internationally standardised methodologies and indicators to 
monitor the growing integration of information and communication technologies into 
education across countries, the UIS has released the Guide to Measuring Information and 
Communication Technologies (ICT) in Education (UIS, 2009). In addition to the UIS core set of 
indicators, this guide presents an expanded list to address a wide range of policy concerns 
in relation to the new paradigm of ICT-enhanced education service delivery. It will help to 
ensure consistent use and interpretation of ICT in education statistics among 
policymakers, statisticians, researchers, experts and statistical institutions across the 
world. This technical paper should serve as a reference and training guide for collecting 
comparable data at the country level and for completing future UIS questionnaires on ICT 
in education. Given the rapidly evolving nature of this field, this is intended to be a living 
document that will be subject to future refinements. 

ICT plays a potentially major role in the promotion of distance education. This is 
particularly so in the context of developing economies, where ICTs, especially the older 
ones, such as the radio and the television, may be used at home in community 
programmes for distance learning. Therefore, data on these facilities would be useful for 
planning such programmes. 

Illiteracy is a major human development issue that can potentially be addressed 
through the application of ICT. Adult literacy rates remain at low levels in many countries, 
with rates usually below 50 per cent in the least developed countries. Radio and television, 
as broadcast technologies, are attractive in Africa because they can leverage costs to 
address the needs of a large number of learners over distance and, with re-broadcast over 
time, these could potentially offer alternative means of delivering information that would 
otherwise be inaccessible to illiterate adults. ICT can aid in the teaching of reading to some 
who would not be reached by conventional learning approaches. Surveys might thus 
consider how to capture a variety of ways in which ICT can improve literacy. 

For-profit ICT training has become a growing service industry in developing 
economies. It offers relatively high-end information processing skills (like managing 
network operating systems software) and also low-end skills, for example, data entry in 
India. 

ICT training (in formal education, non-formal education and private industry-led 
vocational training) for developing economies should not be seen as an ancillary service, 
but as a vital part of ICT infrastructure that must be in place as a precursor to market 
penetration, especially where governments are trying to encourage market growth. 
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The Partnership core indicators of 2010 include a set of core "ICT in education" 
indicators developed by UIS. Through its publication, namely the Guide to Measuring 
Information and Communication Technologies (ICT) in Education, (UIS, 2009), the UIS has also put 
in place an expanded set of internationally standardised indicators and methodological 
tools on ICT in education to help monitor the growing integration of ICT across countries' 
education systems. 

The gender dimension 

In many developing economies, the number of women producers and traders is 
increasing as a result of micro-credit initiatives. Women's dual role (in direct production 
and in caring for the family) typically implies reduced physical business mobility and 
overcoming social barriers to information access. 12 ICT provides an opportunity both to 
give women wider access to information and services as well as allowing them to develop 
their own business skills. In India, there are a number of projects underway, including the 
Smile project (Savitri Marketing Institution for Ladies Empowerment), a voluntary 
organisation in Pune. According to Agarwal (2004), this project has "increased literacy level 
of underprivileged women through the usage of ICT. Internet has also helped them market 
their various products like soft toys, candles, bags, utility items, etc. Through Internet, 
there is greater awareness and exposure and market reach for the products." More 
examples from India can be found in Agarwal (2004). 

Note that classificatory variables recommended for the core individual ICT use 
indicators established by the Partnership (2010) and collected by ITU annually through a 
questionnaire sent to NSOs, include education level and gender. Core indicators on aspects 
of individual use of ICT should therefore be classifiable by gender to provide more 
information on the gender dimension. It is also recommended that developing economies 
aim to collect gender data relating to ICT barriers (where information on the latter is 
collected). 

A methodological issue relating to gender may occur where a patriarchal culture 
makes it difficult to randomly select individuals in household surveys, for instance, if it is 
culturally unacceptable to the patriarch to have his wife selected rather than him. Where 
this is the case, appropriate adjustments should be made so that results are representative 
of the population. 

Health information and services 

Lack of access to information and communication has been identified as a critical 
factor in public health crises around the world. The delivery of information on health, as 
well as various health services, may be facilitated and improved through ICT-based 
solutions. Providing local points of access to life skills education and online consultation 
would be a critical starting point for addressing health care crises in developing economies. 

Availability and use of health care facilities supported or enabled by ICT might be 
measured by adding suitable questions to existing surveys of individuals. In this context, 
note that the core indicators on access to, and use of ICT by households and individuals 
that were established by the Partnership (2005b, 2008b, 2010) include one on individuals' use 
of the Internet to get information related to health or health services. 
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Partnership on measuring ICT for development - core ICT indicators (2010) 



Core indicators on ICT infrastructure and access 



A1 


Fixed telephone lines per 100 inhabitants 


A2 


Mobile cellular telephone subscribers per 100 inhabitants 


A3 


Fixed Internet subscribers per 100 inhabitants 


A4 


Fixed broadband Internet subscribers per 100 inhabitants 


A5 


Mobile broadband subscribers per 100 inhabitants 


A6 


International Internet bandwidth per inhabitant (bits/second/inhabitant) 


A7 


Percentage of population covered by a mobile cellular telephone network 


A8 


Fixed broadband Internet access tariffs (per month), in USD, and as a percentage of monthly per capita income 


A9 


Mobile cellular prepaid tariffs (per month), in US$, and as a percentage of monthly per capita income 


A10 


Percentage of localities with public Internet access centres (PIACs) 


Core indicators on access to, and use of ICT by households and individuals 


HH1 


Proportion of households with a radio 


HH2 


Proportion of households with a TV 


HH3 


Proportion of households with a telephone 

• Any telephone 

• Fixed telephone only 

• Mobile cellular telephone only 

• Both a fixed and a mobile cellular telephone 


HH4 


Proportion of households with a computer 


HH5 


Proportion of individuals who used a computer (from any location) in the last 1 2 months 


HH6 


Proportion of households with Internet access at home 


HH7 


Proportion of individuals who used the Internet (from any location) in the last 12 months 


HH8 


Location of individual use of the Internet in the last 1 2 months 

• Home 

• Work 

• Place of education 

• Another person's home 

• Community Internet access facility commercial Internet access facility any place via a mobile cellular telephone 

• Any place via other mobile access devices 


HH9 


Internet activities undertaken by individuals in the last 1 2 months (from any location) 

• Getting information about goods or services 

• Getting information related to health or health services 

• Getting information from general government organisations 

• Interacting with general government organisations 

• Sending or receiving email 

• Telephoning over the Internet/VoIP 

• Posting information or instant messaging 

• Purchasing or ordering goods or services 

• Internet banking 

• Education or learning activities 

• Playing or downloading videogames or computer games 

• Downloading movies, images, music; watching TV or video; or listening to radio or music 

• Downloading software 

• Reading or downloading online newspapers or magazines, electronic books 


HH10 


Proportion of individuals with use of a mobile cellular telephone in the last 12 months 


HH11 


Proportion of households with access to the Internet by type of access 

• Narrowband 

• Fixed broadband 

• Mobile broadband 


HH12 


Frequency of individual use of the Internet in the last 1 2 months (from any location) 

• at least once a day 

• at least once a week but not every day 

• less than once a week 


Reference indicator 


HHR1 


Proportion of households with electricity 
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Core indicators on use of ICT by businesses 



B1 


Proportion of businesses using computers 


B2 


Proportion of persons employed routinely using computers 


B3 


Proportion of businesses using the Internet 


B4 


Proportion of persons employed routinely using the Internet 


B5 


Proportion of businesses with a web presence 


B6 


Proportion of businesses with an intranet 


B7 


Proportion of businesses receiving orders over the Internet 


B8 


Proportion of businesses placing orders over the Internet 


B9 


Proportion of businesses using the Internet by type of access 
Narrowband 
Fixed broadband 
Mobile broadband 


B10 


Proportion of businesses with a local area network (LAN) 


B11 


Proportion of businesses with an extranet 


B12 


Proportion of businesses using the Internet by type of activity 

Sending or receiving e-mail 

Telephoning over the Internet/VoIP 

Posting information or instant messaging 

Getting information about goods or services 

Getting information from general government organisations 

Interacting with general government organisations 

Internet banking 

Accessing other financial services 
Providing customer services 
Delivering products online 
Internal or external recruitment 
Staff training 


Core indicators on the ICT (producing) sector and trade in ICT goods 


ICT1 


Proportion of total business sector workforce involved in the ICT sector as a proportion of the total business sector 
workforce 


ICT2 


ICT sector share of gross value added as a proportion of total business sector gross value added 


ICT3 


ICT goods imports as a percentage of total imports 


ICT4 


ICT goods exports as a percentage of total exports 


Core indicators on ICT in education 


ED1 


Proportion of schools with a radio used for educational purposes (by ISCED level 1 to 3) 


ED2 


Proportion of schools with a TV used for educational purposes (by ISCED level 1 to 3) 


ED3 


Proportion of schools with a telephone communication facility (by ISCED level 1 to 3) 


ED4 


Learners-to-computer ratio in schools with computer-assisted instruction (by ISCED level 1 to 3) 


ED5 


Proportion of schools with Internet access, by type (by ISCED level 1 to 3) 

Any Internet access 

Access by fixed narrowband only 

Access by fixed broadband only 

Both fixed narrowband and broadband access 


ED6 


Proportion of learners who have access to the Internet at school (by ISCED level 1 to 3) 


ED7 


Proportion of learners enrolled by gender at the post-secondary level in ICT-related fields (for ISCED levels 4, 5 and 6) 


ED8 


Proportion of ICT-qualified teachers in schools (by ISCED level 1 to 3) 


Reference indicator 


EDR1 


Proportion of schools with electricity (by ISCED level 1 to 3)* 



* Since electricity is not specifically an ICT commodity, but an important prerequisite for using many ICTs, it is not 
included in the core list, but included as a reference indicator. International studies reviewed by UIS revealed that the 
lack of electricity is such a significant barrier in many developing economies that monitoring trends of its provision 
is as relevant as monitoring the supply and use of ICT. 
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Classifications for core ICT indicators 

Classificatory variables are used to describe the indicators for business and 
household/individual ICT use and classifications are used for the core indicators on the ICT 
sector and trade. The classifications are described in Partnership (2010). They are: 

• Business characteristics (Industry classification (ISIC) and Employment size). 

• Household characteristics (Household composition and Household size). 

• Individual characteristics (Age ranges, Gender, Highest education level received, Labour 
force status, Occupation). 

• ICT sector (Industry classification (ISIC)). 

• Trade (ICT goods classification); and 

• Education (Levels of education (ISCED), Gender). 

Methodological information associated with the core ICT indicators 

The latest methodological notes on the Partnership's core indicators can be found in 
Partnership (2010), the ITU Manual (ITU, 2009) and the UNCTAD Manual (UNCTAD, 2009). The 
notes include information on measurement concepts, definitions, statistical units, scope 
and coverage. 

Notes 

1. "Developing economy" in this annex does not refer to a homogeneous set of countries and the 
authors do not assume that developing countries cannot collect the data suggested by the Guide. 
Some measurement issues discussed here may not always be relevant, especially for least 
developed countries (LDCs), but could become relevant in the near future with the ever-expanding 
growth of ICT. 

2. It should be noted that older technologies such as radio or television have undergone tremendous 
change in how they disseminate information by converging with digital and wireless technologies. 

3. Co-ordination with other agencies is paramount and this requires that the statistical system of a 
country (including the National Statistical Office, other agencies having statistics as their main 
core business and the statistical units of ministries and government agencies) be able to share a 
common set of definitions (of ICT for example), be aware of each others' data collection activities 
and needs, how they are each serving the common purpose of good national policy making on the 
information society, and what data gaps exist. 

4. For examples, see ITU's case studies on Hong Kong, China and Australia, at: LuiuLu.itu.int/ITU-D/ict/cs/. 

5. See also Annex 8.A1 of this Guide. It provides metadata on ICT statistics produced by OECD 
countries. 

6. Note that the ITU, through its World Telecommunication Indicators Database, collects a range of ICT 
infrastructure data. 

7. ITU, World Telecommunication/ICT Indicators Database, 2010, see: UJUJUJ.itu.int/ITU-D/ict/ 
publications/iuorld/ujorld.html. 

8. For instance, in 2005, IBM agreed to create a reduced function PC for the Indian market (Financial 
Times, May 2005); there is also an agreement between Nokia and a consortium of GSM service 
operators to produce a considerably cheaper mobile phone for emerging markets (The Economist, 
July 2005). 

9. See: Ethnologue, uiuJUJ.ethnoIogue.com. 

10. The SITES project (Second Information Technology in Education Study) includes a set of case 
studies on innovative practices involving ICT (174 studies involving 28 countries in Europe, North 
America, Asia Pacific, Africa, and South America). An analysis of the cases studies found that 
"technology is supporting significant changes in classroom teaching and learning. They paint a 
very different picture than the traditional classroom where the teacher lectures in front of the 
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classroom and students take notes or do worksheets. They show important similarities in how 
technology is being used in many countries around the world." (IEA, 2003). 

11. See: www.acs.org.au/icdl/. 

12. An example of ICT integration in education is a radio instruction project among nomadic women 
in Mongolia called the Gobi Women's Project. It seeks to provide literacy and numeracy instruction 
built around lessons of interest to around 15 000 nomadic women, and to create income 
opportunities for them. Among the programme topics are livestock rearing techniques; family care 
(family planning, health, nutrition and hygiene); income generation using locally available raw 
materials; and basic business skills for a new market economy. See: www.unesco.org/education/ 
educprogAwf/doc/portfolio/casel.htm. 
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